[
https://issues.apache.org/jira/browse/FLINK-25628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jingsong Lee updated FLINK-25628:
---------------------------------
Description:
- Introduce RecordReader interface: The reader that reads the batches of
records.
- Introduce SortMergeReader: This reader is to read a list of `RecordReader`,
which is already sorted by key and sequence number, and perform a sort merge
algorithm. `KeyValue` with the same key will also be combined during sort
merging.
- Introduce ConcatRecordReader: This reader is to concatenate a list of
`RecordReader` and read them sequentially. The input list is already sorted by
key and sequence number, and the key intervals do not overlap each other.
- Introduce FieldStats: Statistics for each field.
- Introduce SstPathFactory: Factory which produces new Path for sst files.
- Introduce SstFile and SstFileMeta: This SstFile includes several `KeyValue`,
representing the changes inserted into the file storage.
> Introduce RecordReader and related classes for table store
> ----------------------------------------------------------
>
> Key: FLINK-25628
> URL: https://issues.apache.org/jira/browse/FLINK-25628
> Project: Flink
> Issue Type: Sub-task
> Components: Table Store
> Reporter: Jingsong Lee
> Assignee: Jingsong Lee
> Priority: Major
> Fix For: table-store-0.1.0
>
>
> - Introduce RecordReader interface: The reader that reads the batches of
> records.
> - Introduce SortMergeReader: This reader is to read a list of `RecordReader`,
> which is already sorted by key and sequence number, and perform a sort merge
> algorithm. `KeyValue` with the same key will also be combined during sort
> merging.
> - Introduce ConcatRecordReader: This reader is to concatenate a list of
> `RecordReader` and read them sequentially. The input list is already sorted
> by key and sequence number, and the key intervals do not overlap each other.
> - Introduce FieldStats: Statistics for each field.
> - Introduce SstPathFactory: Factory which produces new Path for sst files.
> - Introduce SstFile and SstFileMeta: This SstFile includes several
> `KeyValue`, representing the changes inserted into the file storage.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
