tonytanger commented on code in PR #25363:
URL: https://github.com/apache/beam/pull/25363#discussion_r1099254758
##########
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableIO.java:
##########
@@ -182,6 +182,50 @@
*
* }</pre>
*
+ * <h3>Streaming Changes from Cloud Bigtable</h3>
+ *
+ * <p>Cloud Bigtable change streams enable users to capture and stream out
mutations from their
+ * Cloud Bigtable tables in real-time. Cloud Bigtable change streams enable
many use cases including
+ * integrating with a user’s data analytics pipelines, support audit and
archival requirements as
+ * well as triggering downstream application logic on specific database
changes.
+ *
+ * <p>Change stream connector creates and manages a metadata table to manage
the state of the
+ * connector. By default, the table is created in the same instance as the
table being streamed.
+ * However, it can be overridden with {@link
+ * BigtableIO.ReadChangeStream#withMetadataTableProjectId}, {@link
+ * BigtableIO.ReadChangeStream#withMetadataTableInstanceId}, {@link
+ * BigtableIO.ReadChangeStream#withMetadataTableTableId}, and {@link
+ * BigtableIO.ReadChangeStream#withMetadataTableAppProfileId}. The app profile
for the metadata
+ * table must be a single cluster app profile with single row transaction
enabled.
+ *
+ * <p>Note - To prevent unforeseen stream stalls, the Dataflow connector
outputs all data with an
Review Comment:
Yes. Thanks for catching this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
