[
https://issues.apache.org/jira/browse/BEAM-7138?focusedWorklogId=239533&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-239533
]
ASF GitHub Bot logged work on BEAM-7138:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/May/19 00:28
Start Date: 09/May/19 00:28
Worklog Time Spent: 10m
Work Description: ihji commented on issue #8396: [BEAM-7138] keep Java
serialized coder in wire coder construction
URL: https://github.com/apache/beam/pull/8396#issuecomment-490699040
> Reads are deliberately translated by the Runner to be able to support
unbounded sources.
This might not be true for portability framework. I don't know whether
unbounded `Read` transform works just fine on Flink portable runner or not.
But, if it does, I think it's because
`FlinkStreamingPortablePipelineTranslator` does not use `WireCoder` for
translating `Read` transform. In case of
`FlinkBatchPortablePipelineTranslator`, it uses
```
outputCoder = WireCoders.instantiateRunnerWireCoder(collectionNode,
pipeline.getComponents());
```
When `Read` transform run by Flink runner itself produces `PCollection` of
something that should be encoded with `SerializableCoder`, it will throw the
exception because `SerializableCoder` is not supported by a runner wire coder.
If we generate elements with SDF, everything should be okay since the source
`PCollection` is the output of `DoFn` and SDK harness supports any coders.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 239533)
Time Spent: 2h 50m (was: 2h 40m)
> keep Java serialized coder in length-prefixed wire coder construction
> ---------------------------------------------------------------------
>
> Key: BEAM-7138
> URL: https://issues.apache.org/jira/browse/BEAM-7138
> Project: Beam
> Issue Type: Improvement
> Components: java-fn-execution
> Reporter: Heejong Lee
> Assignee: Heejong Lee
> Priority: Major
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> don't replace Java serialized coder with byte array coder in length-prefixed
> wire coder construction.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
