[ 
https://issues.apache.org/jira/browse/BEAM-11392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-11392:
-----------------------------------
    Description: Currently the core SDK has a flag {{beam_fn_api}} that changes 
how side inputs are constructed. The difference is minor. The portable 
expansion already works on all runners except Dataflow and should be the 
default. This is part of making portability the default generally, at least for 
the core SDK and model.  (was: Currently each {{PCollectionView}} is "created" 
by a primitive {{CreatePCollectionView}} primitive in the Java SDK. This is an 
artifact of how runners translated the {{View}} transforms.

But in portability (and actually before that) PCollectionView is just a POJO of 
metadata for how to read a PCollection as a side input. It is PValue to the 
Java SDK but in portability there is only one kind of value: PCollection.

Runners should not depend on the exact expansion of the {{View}} transforms.

Until they are all migrated off of it, the transform must be left in the 
expanion, so runners who are migrated off of it will need to remove it from 
their translation or insert a noop.)

> Resolve beam_fn_api flag that changes how side inputs are represented in Beam
> -----------------------------------------------------------------------------
>
>                 Key: BEAM-11392
>                 URL: https://issues.apache.org/jira/browse/BEAM-11392
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Kenneth Knowles
>            Assignee: Kenneth Knowles
>            Priority: P2
>              Labels: Clarified
>
> Currently the core SDK has a flag {{beam_fn_api}} that changes how side 
> inputs are constructed. The difference is minor. The portable expansion 
> already works on all runners except Dataflow and should be the default. This 
> is part of making portability the default generally, at least for the core 
> SDK and model.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to