Hi Sachin, I’d recommend migrating to the new AWS 2 IOs in beam-sdks-java-io-amazon-web-services2 (using Amazon’s Java SDK v2) rather soon. The previous ones (beam-sdks-java-io-amazon-web-services and beam-sdks-java-io-kinesis) are both deprecated and not actively maintained anymore.
Please have a look at these notes in the changelog: https://github.com/apache/beam/blob/master/CHANGES.md#2410---2022-08-23 https://github.com/apache/beam/blob/master/CHANGES.md#2380---2022-04-20 Currently, neither one supports enhanced fan-out consumers yet. It’s certainly something we’d like to support for the new v2 modules, but I personally didn’t have time to start looking into it so far. https://github.com/apache/beam/issues/19967 Don’t hesitate to reach out in case you are facing any issues when migrating! Kind regards, Moritz On 31.08.22, 10:05, "Sachin Mittal" <sjmit...@gmail.com> wrote: Hello folks, We are consuming from a kinesis stream in our beam application. So far we were using sdk. io. kinesis. KinesisIO to read from kinesis. What I understand is that this library does not use Enhanced Fan-Out Consumer provided by AWS. Hello folks, We are consuming from a kinesis stream in our beam application. So far we were using sdk.io<https://urldefense.com/v3/__http:/sdk.io__;!!CiXD_PY!VUENr73r_r9hNui_jnBewR2JWX7t2IwDXe6_FLFUq43GIFb3-uSIOC9DWmtR3XKaJzp3O-sg6N0iBA$>.kinesis.KinesisIO to read from kinesis. What I understand is that this library does not use Enhanced Fan-Out Consumer provided by AWS. Recently I saw this library sdk.io.aws2.kinesis.KinesisIO and I wanted to understand what is the purpose of this new KinesisIO to read from and write to kinesis ? Does this new library use Enhanced Fan-Out Consumer ? When and how should we decide if we want to migrate to new library or continue to use the current one ? Thanks Sachin
