Edward Zhang created EAGLE-469:
----------------------------------

             Summary: make dataSource configuration extremely simple
                 Key: EAGLE-469
                 URL: https://issues.apache.org/jira/browse/EAGLE-469
             Project: Eagle
          Issue Type: Improvement
    Affects Versions: v0.5.0
            Reporter: Edward Zhang
            Assignee: Edward Zhang
            Priority: Minor
             Fix For: v0.5.0


Today dataSource configuration is very cumbersome, we actually can reduce 
significantly the size of config entries as most of configurations use the 
default values.
"dataSourceConfig": {
    "topic" : "sandbox_hbase_security_log",
    "zkConnection" : "sandbox.hortonworks.com:2181",
    "zkConnectionTimeoutMS" : 15000,
    "consumerGroupId" : "EagleConsumer",
    "fetchSize" : 1048586,
    "deserializerClass" : 
"org.apache.eagle.security.hbase.HbaseAuditLogKafkaDeserializer",
    "transactionZKServers" : "sandbox.hortonworks.com",
    "transactionZKPort" : 2181,
    "transactionZKRoot" : "/consumers",
    "consumerGroupId" : "eagle.hbasesecurity.consumer",
    "transactionStateUpdateMS" : 2000
  }

The new data source config would be like:
"dataSourceConfig": {
    "topic" : "hbase_audit_log",
    "zkConnection" : "server.eagle.apache.org:2181",
    "txZkServers" : "server.eagle.apache.org:2181",
    "schemeCls" : "storm.kafka.StringScheme"
  }



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to