AWS Kinesis Analytics and Pyflink OutputTag

Hi there, I am looking art using Flink to implement a fan-out of events, but discovered a couple of issues attempting to implement on AWS Kinesis Analytics: - the version of Flink is pinned to 1.13.2 - there is currently no version of Pyflink that supports OutputTag Does anyone know if it is poss

OutOfMemoryError (java heap space) on small, local test

Hi there, I am running a local test with: * source = env.from_collection * sink = datastream.execute_and_collect with a map function between, and two very small data points in the collection I'm able to generate an OutOfMemoryError, and due to the nature of this test using simple source and sink,

Re: OutOfMemoryError (java heap space) on small, local test

t; expert to help take a quick look. > > > Best， > Leonard > > 2022年10月31日 上午11:47，Matt Fysh 写道： > > Hi there, > > I am running a local test with: > * source = env.from_collection > * sink = datastream.execute_and_collect > with a map function between, and two ve

Kinesis Connector does not work

Hi, I'm following the kinesis connector instructions as documented here: https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/connectors/datastream/kinesis/ I'm also running Flink in standalone session mode using docker compose and the Python images, as described in the Flink docs (Depl

Re: Kinesis Connector does not work

image, but bundled in your user-jar (along with the connector). > > On 08/11/2022 02:14, Matt Fysh wrote: > > Hi, I'm following the kinesis connector instructions as documented > > here: > > > https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/connecto

How to write custom serializer for dynamodb connector

I'm attempting to use the dynamodb sink located at https://github.com/apache/flink-connector-aws The example in the repo is worki

Re: How to write custom serializer for dynamodb connector

> Hope the above helps. > > > > > > A more general question on your use case, what is the reason you want to > generate the AttributeValue in a previous operator rather than in the sink > directly? Is it for some dynamic generation of objects to write into DDB? &g