[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[
https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977131#comment-15977131
]
Ahmet Altay commented on BEAM-2020:
---
cc: [~robertwb][~sb2nov] Python should remove {{as_cloud_object}} as well.
(Although python changes is not a first stable release blocker.)
> Move CloudObject to Dataflow runner
> ---
>
> Key: BEAM-2020
> URL: https://issues.apache.org/jira/browse/BEAM-2020
> Project: Beam
> Issue Type: Improvement
> Components: beam-model-runner-api, sdk-java-core
>Reporter: Kenneth Knowles
>Assignee: Luke Cwik
> Fix For: First stable release
>
>
> This entails primarily eliminating Coder.asCloudObject() by adding the needed
> accessors, and possibly a serialization registrar discipline, for coders in
> the Runner API proto.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985677#comment-15985677 ] ASF GitHub Bot commented on BEAM-2020: -- GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2716 [BEAM-2020] Add Registrars for Coder Cloud Object Translators Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- This permits registration of a Translator for an arbitrary coder. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tgroh/beam cloud_object_translator_registrar Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2716.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2716 commit 03ea0399d09fe152506092c9b29c75731765a3cb Author: Thomas Groh Date: 2017-04-26T22:31:23Z Add Registrars for Coder Cloud Object Translators This permits registration of a Translator for an arbitrary coder. > Move CloudObject to Dataflow runner > --- > > Key: BEAM-2020 > URL: https://issues.apache.org/jira/browse/BEAM-2020 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core >Reporter: Kenneth Knowles >Assignee: Thomas Groh > Fix For: First stable release > > > This entails primarily eliminating Coder.asCloudObject() by adding the needed > accessors, and possibly a serialization registrar discipline, for coders in > the Runner API proto. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985877#comment-15985877 ] ASF GitHub Bot commented on BEAM-2020: -- Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2716 > Move CloudObject to Dataflow runner > --- > > Key: BEAM-2020 > URL: https://issues.apache.org/jira/browse/BEAM-2020 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core >Reporter: Kenneth Knowles >Assignee: Thomas Groh > Fix For: First stable release > > > This entails primarily eliminating Coder.asCloudObject() by adding the needed > accessors, and possibly a serialization registrar discipline, for coders in > the Runner API proto. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985914#comment-15985914 ] ASF GitHub Bot commented on BEAM-2020: -- GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2727 [BEAM-2020] Add CloudObjectTranslators for Proto, Avro, Serializable Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- Build on top of https://github.com/apache/beam/pull/2679 You can merge this pull request into a Git repository by running: $ git pull https://github.com/tgroh/beam cloud_object_translator_impls_avro_serializable_proto Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2727.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2727 commit f0c08482330c942224ad67c4a38dc4f0f379958c Author: Thomas Groh Date: 2017-04-27T01:02:30Z Add Cloud Object Translators for Coders This consists of most of the formerly AtomicCoders, plus some coders with a known structure. commit ff4aaa1c0ba648a2f41e8ec4d2cae305eada2108 Author: Thomas Groh Date: 2017-04-27T03:05:09Z Add CloudObjectTranslators for Proto, Avro, Serializable This means these coders can be sent to Dataflow with a stable serialization. commit 76c07f719f6f6fc58c19cd19f0b5bc1367e36af4 Author: Thomas Groh Date: 2017-04-27T03:09:47Z Add missing coder TODOs > Move CloudObject to Dataflow runner > --- > > Key: BEAM-2020 > URL: https://issues.apache.org/jira/browse/BEAM-2020 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core >Reporter: Kenneth Knowles >Assignee: Thomas Groh > Fix For: First stable release > > > This entails primarily eliminating Coder.asCloudObject() by adding the needed > accessors, and possibly a serialization registrar discipline, for coders in > the Runner API proto. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989661#comment-15989661 ] ASF GitHub Bot commented on BEAM-2020: -- GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2773 [BEAM-2020] Java-Serialize Coders Directly in the Runner API Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- Known Coders will be serialized via a known path. Unknown Coders will be serialized as a java object. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tgroh/beam coders_serialized_directly Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2773.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2773 commit 60034b985f03f30671f6407990bc91df8dcc290a Author: Thomas Groh Date: 2017-04-29T00:47:36Z Java-Serialize Coders Directly Known Coders will be serialized via a known path. Unknown Coders will be serialized as a java object. > Move CloudObject to Dataflow runner > --- > > Key: BEAM-2020 > URL: https://issues.apache.org/jira/browse/BEAM-2020 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core >Reporter: Kenneth Knowles >Assignee: Thomas Groh > Fix For: First stable release > > > This entails primarily eliminating Coder.asCloudObject() by adding the needed > accessors, and possibly a serialization registrar discipline, for coders in > the Runner API proto. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989740#comment-15989740 ] ASF GitHub Bot commented on BEAM-2020: -- Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2773 > Move CloudObject to Dataflow runner > --- > > Key: BEAM-2020 > URL: https://issues.apache.org/jira/browse/BEAM-2020 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core >Reporter: Kenneth Knowles >Assignee: Thomas Groh > Fix For: First stable release > > > This entails primarily eliminating Coder.asCloudObject() by adding the needed > accessors, and possibly a serialization registrar discipline, for coders in > the Runner API proto. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991806#comment-15991806 ] ASF GitHub Bot commented on BEAM-2020: -- Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2727 > Move CloudObject to Dataflow runner > --- > > Key: BEAM-2020 > URL: https://issues.apache.org/jira/browse/BEAM-2020 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core >Reporter: Kenneth Knowles >Assignee: Thomas Groh > Fix For: First stable release > > > This entails primarily eliminating Coder.asCloudObject() by adding the needed > accessors, and possibly a serialization registrar discipline, for coders in > the Runner API proto. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994126#comment-15994126 ] ASF GitHub Bot commented on BEAM-2020: -- Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2806 > Move CloudObject to Dataflow runner > --- > > Key: BEAM-2020 > URL: https://issues.apache.org/jira/browse/BEAM-2020 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core >Reporter: Kenneth Knowles >Assignee: Thomas Groh > Fix For: First stable release > > > This entails primarily eliminating Coder.asCloudObject() by adding the needed > accessors, and possibly a serialization registrar discipline, for coders in > the Runner API proto. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2020) Move CloudObject to Dataflow runner
[ https://issues.apache.org/jira/browse/BEAM-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994195#comment-15994195 ] ASF GitHub Bot commented on BEAM-2020: -- Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2805 > Move CloudObject to Dataflow runner > --- > > Key: BEAM-2020 > URL: https://issues.apache.org/jira/browse/BEAM-2020 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core >Reporter: Kenneth Knowles >Assignee: Thomas Groh > Fix For: First stable release > > > This entails primarily eliminating Coder.asCloudObject() by adding the needed > accessors, and possibly a serialization registrar discipline, for coders in > the Runner API proto. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
