Thomas Groh created BEAM-3365: --------------------------------- Summary: The Java SDK Harness and runners-core-construction payloads should be consistent Key: BEAM-3365 URL: https://issues.apache.org/jira/browse/BEAM-3365 Project: Beam Issue Type: Bug Components: runner-core, sdk-java-harness Reporter: Thomas Groh Assignee: Luke Cwik
Right now the Java SDK harness expects DoFnInfo instances within the payload of all DoFns it is provided, while the pipeline translation/ParDoTranslation/etc assumes that the ParDoTranslation channel will be used to extract useful values from the serialized form (potentially by converting to a ParDoLike). As such, a Java ParDo serialized with the Java ParDoTranslation class cannot be provided in that form to the Java SDK harness. Instead, that node has to be rewritten to include a {{DoFnInfo}} in the payload. This seems unreasonable, and the two should be brought in line to use the same serialized representation. -- This message was sent by Atlassian JIRA (v6.4.14#64029)