Edward Zhang created EAGLE-54: --------------------------------- Summary: Encoding match between Kafka serialization and Eagle deserialization Key: EAGLE-54 URL: https://issues.apache.org/jira/browse/EAGLE-54 Project: Eagle Issue Type: Improvement Reporter: Edward Zhang Priority: Minor
For various audit logs, Kafka serializes log with String type into bytes, and Eagle deserializes bytes into String. Kafka supports to configure serialization class by specifying kafka.serializer.StringEncoder and encoding type. But Eagle lack the mechanism to deserialize with configuration of encoding, today it does not have issue as it by default uses UTF-8 both. But it is more graceful for Eagle to expose encoding configuration to be aligned with Kafka. https://github.com/apache/kafka/blob/b62f8ea43b6d5307f7274fbe8b7984dd5ee22239/core/src/main/scala/kafka/serializer/Encoder.scala https://github.com/apache/incubator-eagle/blob/bf35ede03a55df9c851669e16c59049f696e0b6d/eagle-security/eagle-security-hdfs-auditlog/src/main/java/org/apache/eagle/security/auditlog/HdfsAuditLogKafkaDeserializer.java -- This message was sent by Atlassian JIRA (v6.3.4#6332)