[
https://issues.apache.org/jira/browse/FLINK-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17453114#comment-17453114
]
Xue Wang commented on FLINK-25021:
----------------------------------
Hi [~MartijnVisser] , I took some time to go through these FLIPs you mentioned
and some recordings of FF21. To start with, I'd like to implement a sink for
ADX using [azure-kusto-java|[https://github.com/Azure/azure-kusto-java].] The
SDK supports both sync and async ingest APIs. Currently, I'm planning to use
async ingestion APIs.
Here are some questions I have so far:
# For async sink, what's the preferred API? SinkWriter
([FLIP-177|[https://cwiki.apache.org/confluence/display/FLINK/FLIP-177%3A+Extend+Sink+API])]
or AsyncSinkWriter
([FLIP-171|[https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink])]
? I see the AsyncSyncWriter is still marked as @PublicEvolving.
# For SyncWriter, I'd like to reference Kafka and ElasticSearch
implementations. For AsyncSinkWriter, I can only see an example in the FLIP.
Would like to hear more from you on which implementations should I reference.
# I learnt from FF21 that you're planning to have separate projects for
connectors. So should I start this work in my own fork of Flink or should I
start a new project instead?
> Source/Sink for Azure Data Explorer (ADX)
> -----------------------------------------
>
> Key: FLINK-25021
> URL: https://issues.apache.org/jira/browse/FLINK-25021
> Project: Flink
> Issue Type: New Feature
> Components: Connectors / Common
> Reporter: Xue Wang
> Assignee: Xue Wang
> Priority: Major
>
> Hi all,
> I'm considering implementing source/sink for Azure Data Explorer (ADX). But
> first I'd like to check with the community if this is already a supported
> scenario. If not, will you consider adding it to the list of official
> connectors?
> FWIW, Azure Data Explorer is a widely used analytic service on Azure well
> suited for ad-hoc and time series analysis over large volume of structured,
> semi-structured, and unstructured data. And it can integrate with a wide
> range of data sources and visualization tools.
> References:
> [General Intro by ADX
> PM|https://vincentlauzon.com/2020/02/19/azure-data-explorer-kusto]
> [ADX
> Documentation|https://docs.microsoft.com/en-us/azure/data-explorer/data-explorer-overview]
> [Ingest data using the Azure Data Explorer Java
> SDK|https://docs.microsoft.com/en-us/azure/data-explorer/java-ingest-data]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
