Greetings,
The Google BigQuery team is reaching out to help customers employ the Flink
BigQuery connector for building better data streaming and analytics
solutions. We recently released a new version (0.4.0), which can be
accessed via GitHub
<https://github.com/GoogleCloudDataproc/flink-bigquery-connector> and Maven
<https://central.sonatype.com/artifact/com.google.cloud.flink/flink-1.17-connector-bigquery/overview>.
With this release, the connector offers all core features that simplify the
integration between Flink and BigQuery.
Highlights:
-
BigQuery sink in Datastream and Table/SQL APIs
-
Offers at-least-once and exactly-once delivery guarantees
-
Maximum parallelism up to 128 (tuned according to BigQuery quota
limits)
-
Insert only
-
BigQuery source (bounded) in Datastream and Table/SQL APIs
-
In-built client management to optimize and abstract BigQuery client
complexities in your Flink applications
-
Flink metrics for runtime observability into BigQuery sink’s performance
We look forward to your valuable feedback for improving this product and
achieving its full potential.
Regards,
Jayant
