[Request Review and Approval] Grab on the "Powered By" Page

2022-07-25 Thread Karan Kamath
Hello Team, My teams at Grab deploy and operate Flink as a platform at South East Asia data scale for our engineers, data scientists, analysts and other data practitioners, and I'd like us to be featured on the https://flink.apache.org/poweredby.html page with the follow

Re: Re: [ANNOUNCE] Apache Flink 1.15.1 released

2022-07-25 Thread podunk
I've added 'taskmanager.resource-id' option to config file and seems it works. Thank you!     Sent: Tuesday, July 12, 2022 at 12:02 PM From: "Gabor Somogyi" To: pod...@gmx.com Cc: "user" Subject: Re: Re: [ANNOUNCE] Apache Flink 1.15.1 released In order to provide a hotfix please set "taskmana

Questions regarding JobManagerWatermarkTracker on AWS Kinesis

2022-07-25 Thread Peter Schrott
Hi there! I have a Flink Job (v 1.13.2, AWS managed) which reads from Kinesis (AWS manger, 4 shards). For reasons the shards are not partitioned properly (at the moment). So I wanted to make use of Watermarks (BoundedOutOfOrdernessTimestampExtractor) and the JobManagerWatermarkTracker to avoid

Re: Does Table API connector, csv, has some option to ignore some columns

2022-07-25 Thread podunk
Could this not be as it was with readCsvFile and the "includeFields" option? That would be nice CSV is just a text file and headers are not required (but can be for human).     Sent: Tuesday, July 12, 2022 at 2:48 PM From: "yuxia" To: "podunk" Cc: "User" Subject: Re: Does Table API connector,

Why this example does not save anything to file?

2022-07-25 Thread podunk
If I get it correctly this is the way how I can save to CSV: https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/filesystem/#full-example   So my code is (read from file, save to file):     package flinkCSV; import org.apache.flink.table.api.EnvironmentSettings; impor

Hybrid Source stop processing files after processing 128 SourceFactories

2022-07-25 Thread Benenson, Michael via user
Hi, folks I have tried fix FLINK-27479 for Hybrid Source from https://github.com/apache/flink/pull/20215 in Flink 14.3 It works fine, but Flink stops processing files after processing 128 SourceFactories. I have run this program a few times, s