sehaj pal singh sandhu created RANGER-4947:
----------------------------------------------
Summary: Kafka ranger-plugin HDFS Audits failing -
org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme
"hdfs"
Key: RANGER-4947
URL: https://issues.apache.org/jira/browse/RANGER-4947
Project: Ranger
Issue Type: Bug
Components: plugins
Affects Versions: 2.5.0
Reporter: sehaj pal singh sandhu
Error seen when Kafka ranger plugin tries to write audit logs to HDFS.
{code:java}
2024-09-22 19:18:22,424 ERROR
[kafka.async.summary.batch_kafka.async.summary.batch.hdfs_destWriter]
org.apache.ranger.audit.utils.RangerJSONAuditWriter
(RangerJSONAuditWriter.java:117) - Exception encountered while writing audits
to HDFS!
org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme
"hdfs"
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3585)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3608)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3712)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3663)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557)
at
org.apache.ranger.audit.utils.AbstractRangerAuditWriter.createFileSystemFolders(AbstractRangerAuditWriter.java:97)
at
org.apache.ranger.audit.utils.AbstractRangerAuditWriter.createWriter(AbstractRangerAuditWriter.java:279)
at
org.apache.ranger.audit.utils.RangerJSONAuditWriter.getLogFileStream(RangerJSONAuditWriter.java:170)
at
org.apache.ranger.audit.utils.RangerJSONAuditWriter$1.run(RangerJSONAuditWriter.java:99)
at
org.apache.ranger.audit.utils.RangerJSONAuditWriter$1.run(RangerJSONAuditWriter.java:96)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
at
org.apache.ranger.audit.provider.MiscUtil.executePrivilegedAction(MiscUtil.java:560)
at
org.apache.ranger.audit.utils.RangerJSONAuditWriter.logJSON(RangerJSONAuditWriter.java:96)
at
org.apache.ranger.audit.utils.RangerJSONAuditWriter.log(RangerJSONAuditWriter.java:137)
at
org.apache.ranger.audit.destination.HDFSAuditDestination.logJSON(HDFSAuditDestination.java:79)
at
org.apache.ranger.audit.queue.AuditFileSpool.sendEvent(AuditFileSpool.java:769)
{code}
The error seems to come due to some missing jars needed to handle the hdfs
filesystem in ranger-plugin.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
