Hey, There is no error with the parallelism .I want to increase it for this function as it is creating a bottleneck for the disk space which I am not able to do.
I tried using setParallelism() here but I think it doesn't comply with flink schema and is using default parallelism instead Can you please help me with this? How can I increase the parallelism of this keyBy and window combination here. Thanks, Sambhav Gupta On Mon, 26 May 2025, 14:21 Pedro Mázala, <[email protected]> wrote: > What is the error on the parallelism you're facing? > > > > Att, > Pedro Mázala > Be awesome > > > On Mon, 26 May 2025 at 10:13, Sambhav Gupta <[email protected]> > wrote: > >> Hi Team, >> >> We are migrating our codebase of flink to V2.1 version. Here were using >> dataset jobs which we need to migrate to data stream now and while doing >> this we faced an error of parallelism of keyby and window function in our >> full outerjoin function which is creating bottleneck for us in case of disk >> storage and compute >> >> The code structure >> >> We have 2 inputs db2stream and kafka input on which we perform outerjoin >> function >> >> Db2Stream.keyby(key selector) >> .cogroup(kafka input) >> .where(key) >> .equalto(key) >> .window(endOfStreamWindow.get) >> .apply(<join function>) >> >> >> Can you please help me with increasing Parallelism of this function in >> anyway so that we can remove our bottleneck while migrating it from dataset >> to datastream >> >> Thanks, >> Sambhav Gupta >> >> >> >>
