[ https://issues.apache.org/jira/browse/RANGER-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
woosuk.ro updated RANGER-4808: ------------------------------ Description: In the current implementation of Impala plugin’s Audit V3, the {{KafkaAuditProvider}} cannot be properly initialized because it lacks the {{init(Properties props, String basePropertyName)}} method. Additionally, it depends on Kafka client version 0.8.0, which complicates integration with newer Kafka versions. This proposal introduces two key improvements: *1. Implement the init(Properties props, String basePropertyName) method* - Add the {{init(Properties props, String basePropertyName)}} method to properly initialize the {{KafkaAuditProvider}} in an Audit V3 environment. *2. Dynamic Configuration* - Enable dynamic setting of Kafka Producer configuration values within the {{{}*KafkaAuditProvider*{}}}, allowing more flexible and customizable configurations. By implementing these changes, the {{KafkaAuditProvider}} will work seamlessly with updated Kafka clients and support dynamic configuration, ultimately enhancing audit logging in Impala. was: In the current implementation of Audit V3 in Impala, the KafkaAuditProvider was not properly initialized due to the absence of the init(Properties props, String basePropertyName) function. Additionally, the existing implementation relied on Kafka Client version 0.8.0, which made it difficult to use This issue proposes the following enhancements to the KafkaAuditProvider for better integration and functionality: 1. Implement the init(Properties props, String basePropertyName) method to properly initialize the KafkaAuditProvider when using Audit V3. 2. Dynamic Configuration: Modify the KafkaAuditProvider to dynamically set the configuration values for the Kafka Producer during its creation. This enhancement allows for more flexible and customizable configurations based on the properties provided. These improvements ensure that the KafkaAuditProvider works seamlessly with the latest Kafka clients and supports dynamic configuration, enhancing the overall audit logging capability in Impala. > Enhance KafkaAuditProvider for Audit V3 > --------------------------------------- > > Key: RANGER-4808 > URL: https://issues.apache.org/jira/browse/RANGER-4808 > Project: Ranger > Issue Type: Improvement > Components: audit > Reporter: woosuk.ro > Priority: Major > Fix For: 2.3.0, 2.4.0 > > Time Spent: 10m > Remaining Estimate: 0h > > In the current implementation of Impala plugin’s Audit V3, the > {{KafkaAuditProvider}} cannot be properly initialized because it lacks the > {{init(Properties props, String basePropertyName)}} method. Additionally, it > depends on Kafka client version 0.8.0, which complicates integration with > newer Kafka versions. > This proposal introduces two key improvements: > *1. Implement the init(Properties props, String basePropertyName) method* > - Add the {{init(Properties props, String basePropertyName)}} method to > properly initialize the {{KafkaAuditProvider}} in an Audit V3 environment. > *2. Dynamic Configuration* > - Enable dynamic setting of Kafka Producer configuration values within the > {{{}*KafkaAuditProvider*{}}}, allowing more flexible and customizable > configurations. > > By implementing these changes, the {{KafkaAuditProvider}} will work > seamlessly with updated Kafka clients and support dynamic configuration, > ultimately enhancing audit logging in Impala. -- This message was sent by Atlassian Jira (v8.20.10#820010)