Hi all,

I want to bring up a discussion about Paimon QueryService [1].

Paimon primary key table already provides LSM file structure, it is a
pity that the paimon can not provide a queryable service for lookup.

A distributed service can download Paimon files locally and provide a
Lookup service. It does not affect the write process and read process,
it is a separate server. It can be used as:

1. Flink Lookup Join, reuse by multiple Flink Jobs.
2. Online Service Lookup, this requires high stability. (it may not be
so stable in the first version)

See more in PIP [1].

This PIP is a high-level design for Paimon QueryService, not including
all details.

[1] 
https://cwiki.apache.org/confluence/display/PAIMON/PIP-10%3A+Introduce+Paimon+QueryService

Best,
Jingsong

Reply via email to