[
https://issues.apache.org/jira/browse/HUDI-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lin Liu updated HUDI-9235:
--------------------------
Description:
We should have a poc for this task first to ensure the direction is correct,
and expose potential risks.
* Figure out the hfile base file reader (DONE)
* Create Spark hfile reader hierarchy (DONE)
* Extend FG reader for HFile (DONE)
* Create functional tests for reading Hfile based file groups through this
API. (DONE)
We don't need to worry about MDT at this step.
was:
We should have a poc for this task first to ensure the direction is correct,
and expose potential risks.
# Figure out the base file.
# Create Spark file reader (log file reader)
# Extend FG reader for HFile
# Create functional tests for reading Hfile based file groups through this API.
# We don't need to worry about MDT at this step.
> Create a POC for HFile based FG reader
> --------------------------------------
>
> Key: HUDI-9235
> URL: https://issues.apache.org/jira/browse/HUDI-9235
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Lin Liu
> Assignee: Lin Liu
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.1.0
>
>
> We should have a poc for this task first to ensure the direction is correct,
> and expose potential risks.
>
> * Figure out the hfile base file reader (DONE)
> * Create Spark hfile reader hierarchy (DONE)
> * Extend FG reader for HFile (DONE)
> * Create functional tests for reading Hfile based file groups through this
> API. (DONE)
> We don't need to worry about MDT at this step.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
