qinghuan <1095193...@qq.com>
> *Sent:* Monday, January 17, 2022 18:27
> *To:* user@flink.apache.org
> *Subject:* Re: [FEEDBACK] Metadata Platforms / Catalogs / Lineage
> integration
>
>
> we are using Datahub to address table-level lineage and column-level
> lineage fo
;1095193...@qq.com>
Sent: Monday, January 17, 2022 18:27
To: user@flink.apache.org
Subject: Re: [FEEDBACK] Metadata Platforms / Catalogs / Lineage integration
we are using Datahub to address table-level lineage and column-level lineage
for Flink SQL.
在 2022/1/13 23:27, Martijn Visser 写道:
Hi eve
we are using Datahub to address table-level lineage and column-level
lineage for Flink SQL.
在 2022/1/13 23:27, Martijn Visser 写道:
Hi everyone,
I'm currently checking out different metadata platforms, such as
Amundsen [1] and Datahub [2]. In short, these types of tools try to
address
Hi
I am a software engineer from Xiaomi.
Last year we used metacat(https://github.com/Netflix/metacat) to manage all
metadata, including Hive, Kudu, Doris, Iceberg, Elasticsearch, Talos
(Xiaomi self-developed message queue), Mysql, Tidb..
Metacat is well compatible with the hive-metastore
Hello,
I'm an OpenLineage committer - and previously, a minor Flink contributor.
OpenLineage community is very interested in conversation about Flink
metadata, and we'll be happy to cooperate with the Flink community.
Best,
Maciej Obuchowski
czw., 13 sty 2022 o 18:12 Martijn Visser
Hi all,
@Andrew thanks for sharing that!
@Tero good point, I should have clarified the purpose. I want to understand
what "metadata platforms" tools are used or evaluated by the Flink
community, what's their purpose for using such a tool (is it as a generic
catalogue, as a data discovery tool,
Hello,
I'm part of the DataHub community and working in collaboration with the
company behind it: http://acryldata.io
Happy to have a conversation or clarify any questions you may have on
DataHub :)
Have a nice day!
Em qui., 13 de jan. de 2022 às 15:33, Andrew Otto
escreveu:
> Hello! The
Hello! The Wikimedia Foundation is currently doing a similar evaluation
(although we are not currently including any Flink considerations).
https://wikitech.wikimedia.org/wiki/Data_Catalog_Application_Evaluation_Rubric
More details will be published there as folks keep working on this.
Hope
