Hello Dev!

I've got PR 13789 [0] out to resolve BEAM-11200 [1] which was discovered
around the time of the 2.26.0 release cut.

In particular, a Dataflow update began blocking SDKs older than 2.16.0 per
their support policy[2], which caused the Go SDK Post Commit tests against
Dataflow to fail. The fix was to update the version of the SDK to something
more representative of what it supports.

Notionally, as an experimental SDK, the Go SDK is "unversioned". However,
given it was an Dataflow service release that broke the post commits, and
not a change to the SDK itself, the fix was fortunately simple, however
manual.

The linked PR simply automatically increments the SDK's own estimation of
it's version along with what is done for the Python SDK, for submission to
runners that wish to have that information (such as Dataflow).

While this is a step towards getting the Go SDK out of experimental,
there's one or two more things (like finishing schema support (so close!) ,
and updating documentation + programming guide) to do before we declare
"Henceforth the Go SDK is no longer experimental as of version 2.XX.0 of
Beam!" We'll have a vote and everything for that, I promise. I'll be
outlining everything the SDK presently supports in that email.

Note that this doesn't change the current Go SDK user experience. Users can
presently request arbitrary versions of the SDK, because the way Go handles
versioning is to just check for the tags on the source repo. A "2.27.0"
version of the SDK already exists, and users can depend on it.

Further note that this is a very minor change to the release procedure, and
doesn't automatically release versioned containers for the SDK. That
requires changing different scripts.

Thanks for your patience with this lengthy email, and hopefully I can
finish enough things to send an even bigger email soon. Please let me know
if you have any questions about this change or the Go SDK.

Robert Burke
defacto Apache Beam Go SDK expert

[0] https://github.com/apache/beam/pull/13789
[1] https://issues.apache.org/jira/browse/
[2]
https://cloud.google.com/dataflow/docs/support/sdk-version-support-status

Reply via email to