[ANNOUNCE] Beam 2.31.0 Released

2021-07-09 Thread Andrew Pilloud
The Apache Beam team is pleased to announce the release of version 2.31.0. Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. See https://beam.apache.org You can download the release her

Flaky test issue report (29)

2021-07-09 Thread Beam Jira Bot
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determin

P1 issues report (42)

2021-07-09 Thread Beam Jira Bot
This is your daily summary of Beam's current P1 issues, not including flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20priority%20%3D%20P1%20AND%20(labels%20is%20EMPTY%20OR%20labels%20!%3D%20flake). See https://beam.apache.

Re: Dataflow dependencies require non-maven central dependencies (confluent kafka)

2021-07-09 Thread Alexey Romanenko
Hi Alex, Yes, starting from Beam 2.20.0, "beam-sdks-java-io-kafka” requires an additional dependency “kafka-avro-serializer” from external repository (https://packages.confluent.io/maven/). This is reflected in published POM file: https://search.maven.org/artifact/org.apache.beam/beam-sdks-j

Dataflow dependencies require non-maven central dependencies (confluent kafka)

2021-07-09 Thread Alex Van Boxel
Hi all, I've been building for years via gradle. The dependency management is probably a bit different from that of maven, but it seems that dataflow now requires Confluent Kafka dependencies. They are not available in Maven Central. This feels wrong for an Apache project. - file:/Users/al