[
https://issues.apache.org/jira/browse/HUDI-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-9117:
---------------------------------
Description:
*LogScanner is still used by
* Some paths in Hive
* HoodieMergedReadHandle
* FileSliceReader
* Java Client
* Some odd classes in CLI
* MetadataTable.
* Flink.
How to go about this
- We need a log reader impl, that can work with Avro/Indexed Records, to be
used for Java/CLI?
- Need to understand semantic differences between the two classes if any
(bridge)
- Any functionality gaps e.g spillable map support?
- Should rest of code simply work with FileGroupReader with optional base file
(instead of reader...?)
was:
*LogScanner is still used by
* Some paths in Hive
* HoodieMergedReadHandle/FileSliceReader
* Java Client
* Some odd classes in CLI
* MetadataTable.
* Flink.
How to go about this
- We need a log reader impl, that can work with Avro/Indexed Records, to be
used for Java/CLI?
- Need to understand semantic differences between the two classes if any
(bridge)
- Any functionality gaps e.g spillable map support?
- Should rest of code simply work with FileGroupReader with optional base file
(instead of reader...?)
> Reduce usage of *LogScanner and standardize on *LogReader..
> -----------------------------------------------------------
>
> Key: HUDI-9117
> URL: https://issues.apache.org/jira/browse/HUDI-9117
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Vinoth Chandar
> Assignee: Vinoth Chandar
> Priority: Blocker
> Fix For: 1.1.0
>
>
> *LogScanner is still used by
> * Some paths in Hive
> * HoodieMergedReadHandle
> * FileSliceReader
> * Java Client
> * Some odd classes in CLI
> * MetadataTable.
> * Flink.
> How to go about this
> - We need a log reader impl, that can work with Avro/Indexed Records, to be
> used for Java/CLI?
> - Need to understand semantic differences between the two classes if any
> (bridge)
> - Any functionality gaps e.g spillable map support?
> - Should rest of code simply work with FileGroupReader with optional base
> file (instead of reader...?)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
