[jira] [Updated] (BEAM-2902) Add user state support for ParDo.Multi for the Dataflow runner

2019-03-18 Thread Kenneth Knowles (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-2902:
--
Labels: portability sickbay triaged  (was: portability sickbay)

> Add user state support for ParDo.Multi for the Dataflow runner
> --
>
> Key: BEAM-2902
> URL: https://issues.apache.org/jira/browse/BEAM-2902
> Project: Beam
>  Issue Type: Sub-task
>  Components: runner-dataflow
>Reporter: Luke Cwik
>Priority: Minor
>  Labels: portability, sickbay, triaged
>
> Add support for user state in a ParDo.Multi by:
> * adding expansion/conversion logic within Dataflow service to add any needed 
> GBKs to allow expansion.
> *OR*
> * Add support for expansion inside the Beam SDK once the PTransformMatcher 
> exposes a way to know when the replacement is not required by checking that 
> the preceding ParDos to a GBK are key preserving.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (BEAM-2902) Add user state support for ParDo.Multi for the Dataflow runner

2019-02-15 Thread Ahmet Altay (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ahmet Altay updated BEAM-2902:
--
Fix Version/s: (was: 2.11.0)

> Add user state support for ParDo.Multi for the Dataflow runner
> --
>
> Key: BEAM-2902
> URL: https://issues.apache.org/jira/browse/BEAM-2902
> Project: Beam
>  Issue Type: Sub-task
>  Components: runner-dataflow
>Reporter: Luke Cwik
>Priority: Minor
>  Labels: portability, sickbay
>
> Add support for user state in a ParDo.Multi by:
> * adding expansion/conversion logic within Dataflow service to add any needed 
> GBKs to allow expansion.
> *OR*
> * Add support for expansion inside the Beam SDK once the PTransformMatcher 
> exposes a way to know when the replacement is not required by checking that 
> the preceding ParDos to a GBK are key preserving.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (BEAM-2902) Add user state support for ParDo.Multi for the Dataflow runner

2019-01-15 Thread Kenneth Knowles (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-2902:
--
Fix Version/s: 2.11.0

> Add user state support for ParDo.Multi for the Dataflow runner
> --
>
> Key: BEAM-2902
> URL: https://issues.apache.org/jira/browse/BEAM-2902
> Project: Beam
>  Issue Type: Sub-task
>  Components: runner-dataflow
>Reporter: Luke Cwik
>Priority: Minor
>  Labels: portability, sickbay
> Fix For: 2.11.0
>
>
> Add support for user state in a ParDo.Multi by:
> * adding expansion/conversion logic within Dataflow service to add any needed 
> GBKs to allow expansion.
> *OR*
> * Add support for expansion inside the Beam SDK once the PTransformMatcher 
> exposes a way to know when the replacement is not required by checking that 
> the preceding ParDos to a GBK are key preserving.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)