The pipeline in question is using Dataflow v1 Runner (Runner v2: Disabled)
in case that's an important detail.

On Tue, Dec 12, 2023 at 4:22 PM Evan Galpin <[email protected]> wrote:

> I've checked the source code and deployment command for cases of setting
> experiments. I don't see "enable_custom_pubsub_source" being used at all,
> no.  I also confirmed that it is not active on the existing/running job.
>
> On Tue, Dec 12, 2023 at 4:11 PM Reuven Lax via user <[email protected]>
> wrote:
>
>> Are you setting the enable_custom_pubsub_source experiment by any chance?
>>
>> On Tue, Dec 12, 2023 at 3:24 PM Evan Galpin <[email protected]> wrote:
>>
>>> Hi all,
>>>
>>> When attempting to upgrade a running Dataflow pipeline from SDK 2.51.0
>>> to 2.52.0, an incompatibility warning is surfaced that prevents pipeline
>>> upgrade:
>>>
>>>
>>>> The Coder or type for step .../PubsubUnboundedSource has changed
>>>
>>>
>>> Was there an intentional coder change introduced for PubsubMessage in
>>> 2.52.0?  I didn't note anything in the release notes
>>> https://beam.apache.org/blog/beam-2.52.0/ nor recent changes in
>>> PubsubMessageWithAttributesCoder[1].  Specifically the step uses
>>> `PubsubMessageWithAttributesCoder` via
>>> `PubsubIO.readMessagesWithAttributes()`
>>>
>>> Thanks!
>>>
>>>
>>> [1]
>>> https://github.com/apache/beam/blob/90e79ae373ab38cf4e48e9854c28aaffb0938458/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubMessageWithAttributesCoder.java#L36
>>>
>>

Reply via email to