Thomas Groh created BEAM-3365:
---------------------------------

             Summary: The Java SDK Harness and runners-core-construction 
payloads should be consistent
                 Key: BEAM-3365
                 URL: https://issues.apache.org/jira/browse/BEAM-3365
             Project: Beam
          Issue Type: Bug
          Components: runner-core, sdk-java-harness
            Reporter: Thomas Groh
            Assignee: Luke Cwik


Right now the Java SDK harness expects DoFnInfo instances within the payload of 
all DoFns it is provided, while the pipeline translation/ParDoTranslation/etc 
assumes that the ParDoTranslation channel will be used to extract useful values 
from the serialized form (potentially by converting to a ParDoLike). As such, a 
Java ParDo serialized with the Java ParDoTranslation class cannot be provided 
in that form to the Java SDK harness. Instead, that node has to be rewritten to 
include a {{DoFnInfo}} in the payload.

This seems unreasonable, and the two should be brought in line to use the same 
serialized representation.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to