[GitHub] [hudi] yihua commented on issue #6137: [SUPPORT] Hudi 0.10.1 throws NoSuchMethodError: org.apache.spark.sql.execution.datasources.FileStatusCache.putLeafFiles(Lorg/apache/hadoop/fs/Path;[Lorg

2022-11-01 Thread GitBox
yihua commented on issue #6137: URL: https://github.com/apache/hudi/issues/6137#issuecomment-1299285953 Here is one fix that is in progress, by optionally falling back to using Spark's data source with`HoodieROTablePathFilter` (how data source read is implemented pre-0.9.0 release) instead

[GitHub] [hudi] yihua commented on issue #6137: [SUPPORT] Hudi 0.10.1 throws NoSuchMethodError: org.apache.spark.sql.execution.datasources.FileStatusCache.putLeafFiles(Lorg/apache/hadoop/fs/Path;[Lorg

2022-09-17 Thread GitBox
yihua commented on issue #6137: URL: https://github.com/apache/hudi/issues/6137#issuecomment-1250135796 It looks like the FileStatusCache APIs are different between OSS and Databricks Spark runtime, causing the NoSuchMethodError. -- This is an automated message from the Apache Git Service