Edward Zhang created EAGLE-469: ---------------------------------- Summary: make dataSource configuration extremely simple Key: EAGLE-469 URL: https://issues.apache.org/jira/browse/EAGLE-469 Project: Eagle Issue Type: Improvement Affects Versions: v0.5.0 Reporter: Edward Zhang Assignee: Edward Zhang Priority: Minor Fix For: v0.5.0
Today dataSource configuration is very cumbersome, we actually can reduce significantly the size of config entries as most of configurations use the default values. "dataSourceConfig": { "topic" : "sandbox_hbase_security_log", "zkConnection" : "sandbox.hortonworks.com:2181", "zkConnectionTimeoutMS" : 15000, "consumerGroupId" : "EagleConsumer", "fetchSize" : 1048586, "deserializerClass" : "org.apache.eagle.security.hbase.HbaseAuditLogKafkaDeserializer", "transactionZKServers" : "sandbox.hortonworks.com", "transactionZKPort" : 2181, "transactionZKRoot" : "/consumers", "consumerGroupId" : "eagle.hbasesecurity.consumer", "transactionStateUpdateMS" : 2000 } The new data source config would be like: "dataSourceConfig": { "topic" : "hbase_audit_log", "zkConnection" : "server.eagle.apache.org:2181", "txZkServers" : "server.eagle.apache.org:2181", "schemeCls" : "storm.kafka.StringScheme" } -- This message was sent by Atlassian JIRA (v6.3.4#6332)