RE: MSI Auth to Azure Storage Account with Flink Apache Operator not working

2023-05-19 Thread Ivan Webber via user
I will provide more details as to how I was able to use AKV with CSI. Also, I looked in the Flink source at the ADLS FileSystem factory and I think despite what it says in the docs configuration options prefixed with flink.hadoop won’t get forwarded. You can expose the key vault as Kubernetes s

ElasticsearchConnector for ES 8.1x

2023-05-19 Thread patricia lee
Flink 1.17 Elasticsearch 8.1.1 Description: Upgrading to Flink 1.17 from 1.8. ElasticsearchSink is already deprecated and I am using the flink-connector-elasticsearch7. This throws an IO exception, unable to parse response body. But when I downgraded to Elasticsearch 7.17 it worked. Question: I

RE: Getting exception when writing to parquet file with generic types disabled

2023-05-19 Thread Aniket Sule
Thank you for the explanation and creating the JIRA issue. Appreciate your help. Regards Aniket Sule From: Shammon FY Sent: Thursday, May 18, 2023 10:28 PM To: Aniket Sule Cc: user@flink.apache.org Subject: Re: Getting exception when writing to parquet file with generic types disabled You don

Re: IRSA with Flink S3a connector

2023-05-19 Thread Anuj Jain
Hi Community, Looking forward to some advice on the problem. I also found this similar Jira, but not sure if a fix has been done for the Hadoop connector - can someone confirm this. [FLINK-23487] IRSA doesn't work with S3 - ASF JIRA (apache.org)