egalpin commented on PR #22216: URL: https://github.com/apache/beam/pull/22216#issuecomment-1190736887
At the risk of hijacking... Having support for orderingKey is high-priority for me as well, so I've been playing around with this locally. I can't for the life of me get it to work with dataflow when attempting to publish messages with an ordering key. I did get it to work locally, where I could see (via the GCP UI) published messages had orderingKey assigned. Something must be overriding it in dataflow. Thought it might be worth mentioning. I also had a lot of trouble with coders and getting the correct coder to be maintained throughout the publish process, specifically the coder would be altered to be `PubsubMessageWithAttributesCoder` after data went through [PubsubMessages.ParsePayloadAsPubsubMessageProto](https://github.com/apache/beam/blob/367173f6245f8df514b2e0526ab659665344f5a6/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubUnboundedSink.java#L414-L415). I'm definitely missing an understanding of how to make proper use of CoderRegistrar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
