Hi devs,

I'm excited to propose a new FLIP[1] aimed at enhancing the DataStream API

to support full window processing on non-keyed streams. This feature addresses
the current limitation where non-keyed DataStreams cannot accumulate records
per subtask for collective processing at the end of input.

Key proposals include:


1. Introduction of PartitionWindowedStream allowing non-keyed DataStreams to
be transformed for full window processing per subtask.

2. Addition of four new APIs - mapPartition, sortPartition, aggregate, and 
reduce
- to enable powerful operations on PartitionWindowedStream.

This initiative seeks to fill the gap left by the deprecation of the DataSet 
API,
marrying its partition processing strengths with the dynamic capabilities
of the DataStream API.

Looking forward to your feedback on this FLIP.

[1] 
https://cwiki.apache.org/confluence/display/FLINK/FLIP-380%3A+Support+Full+Partition+Processing+On+Non-keyed+DataStream

Best regards,
Wencong Liu

Reply via email to