Hi devs, We would like to start a discussion about PIP-5: Paimon Table And Data Lineage For Flink[1].
As a streaming lake, users can use Paimon integrated with Flink to complete the entire ETL processing. In this process, users need to manage batch & streaming jobs and data streams, including batch & streaming data validation, job debug, and data revision. To support the above ability, we introduce table and data lineage for Flink & Paimon. Users can conveniently manage the entire ETL processing based on lineage information. Looking forward to hearing from you, thanks. [1] https://cwiki.apache.org/confluence/display/PAIMON/PIP-5%3A+Paimon+Table+And+Data+Lineage+For+Flink Best, Shammon FY
