[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[
https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=152626=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-152626
]
ASF GitHub Bot logged work on BEAM-2887:
Author: ASF GitHub Bot
Created on: 09/Oct/18 10:55
Start Date: 09/Oct/18 10:55
Worklog Time Spent: 10m
Work Description: robertwb closed pull request #6504: [BEAM-2887] Remove
special FnApi version of wordcount.
URL: https://github.com/apache/beam/pull/6504
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/sdks/python/apache_beam/examples/wordcount_fnapi.py
b/sdks/python/apache_beam/examples/wordcount_fnapi.py
deleted file mode 100644
index bf4998af15e..000
--- a/sdks/python/apache_beam/examples/wordcount_fnapi.py
+++ /dev/null
@@ -1,146 +0,0 @@
-#
-# Licensed to the Apache Software Foundation (ASF) under one or more
-# contributor license agreements. See the NOTICE file distributed with
-# this work for additional information regarding copyright ownership.
-# The ASF licenses this file to You under the Apache License, Version 2.0
-# (the "License"); you may not use this file except in compliance with
-# the License. You may obtain a copy of the License at
-#
-#http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
-#
-
-"""A word-counting workflow using the experimental FnApi.
-
-For the stable wordcount example see wordcount.py.
-"""
-
-# TODO(BEAM-2887): Merge with wordcount.py.
-
-from __future__ import absolute_import
-
-import argparse
-import logging
-import re
-
-from past.builtins import unicode
-
-import apache_beam as beam
-from apache_beam.io import ReadFromText
-# TODO(BEAM-2887): Enable after the issue is fixed.
-# from apache_beam.io import WriteToText
-from apache_beam.metrics import Metrics
-from apache_beam.metrics.metric import MetricsFilter
-from apache_beam.options.pipeline_options import DebugOptions
-from apache_beam.options.pipeline_options import PipelineOptions
-from apache_beam.options.pipeline_options import SetupOptions
-
-
-class WordExtractingDoFn(beam.DoFn):
- """Parse each line of input text into words."""
-
- def __init__(self):
-super(WordExtractingDoFn, self).__init__()
-self.words_counter = Metrics.counter(self.__class__, 'words')
-self.word_lengths_counter = Metrics.counter(self.__class__, 'word_lengths')
-self.word_lengths_dist = Metrics.distribution(
-self.__class__, 'word_len_dist')
-self.empty_line_counter = Metrics.counter(self.__class__, 'empty_lines')
-
- def process(self, element):
-"""Returns an iterator over the words of this element.
-
-The element is a line of text. If the line is blank, note that, too.
-
-Args:
- element: the element being processed
-
-Returns:
- The processed element.
-"""
-text_line = element.strip()
-if not text_line:
- self.empty_line_counter.inc(1)
-words = re.findall(r'[A-Za-z\']+', text_line)
-for w in words:
- self.words_counter.inc()
- self.word_lengths_counter.inc(len(w))
- self.word_lengths_dist.update(len(w))
-return words
-
-
-def run(argv=None):
- """Main entry point; defines and runs the wordcount pipeline."""
- parser = argparse.ArgumentParser()
- parser.add_argument('--input',
- dest='input',
- default='gs://dataflow-samples/shakespeare/kinglear.txt',
- help='Input file to process.')
- parser.add_argument('--output',
- dest='output',
- required=True,
- help='Output file to write results to.')
- known_args, pipeline_args = parser.parse_known_args(argv)
-
- # We use the save_main_session option because one or more DoFn's in this
- # workflow rely on global context (e.g., a module imported at module level).
- pipeline_options = PipelineOptions(pipeline_args)
- pipeline_options.view_as(SetupOptions).save_main_session = True
- p = beam.Pipeline(options=pipeline_options)
-
- # Ensure that the experiment flag is set explicitly by the user.
- debug_options = pipeline_options.view_as(DebugOptions)
- use_fn_api = (
- debug_options.experiments and 'beam_fn_api' in debug_options.experiments)
- assert use_fn_api, 'Enable beam_fn_api experiment, in order run this
example.'
-
- # Read the text file[pattern] into a PCollection.
- lines = p |
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=152563=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-152563 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 09/Oct/18 07:21 Start Date: 09/Oct/18 07:21 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-428087330 Thanks. This test is passing regularly, but I'd really like to see an all-clean run before merging. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 152563) Time Spent: 2h 20m (was: 2h 10m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 2h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=152564=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-152564 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 09/Oct/18 07:21 Start Date: 09/Oct/18 07:21 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-428087351 Run Python Postcommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 152564) Time Spent: 2.5h (was: 2h 20m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 2.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151952=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151952 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 06/Oct/18 08:27 Start Date: 06/Oct/18 08:27 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-427556457 Run Python Postcommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 151952) Time Spent: 2h 10m (was: 2h) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 2h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151134=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151134 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 04/Oct/18 11:21 Start Date: 04/Oct/18 11:21 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-426982250 Run Python PostCommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 151134) Time Spent: 1h 50m (was: 1h 40m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 1h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151135=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151135 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 04/Oct/18 11:21 Start Date: 04/Oct/18 11:21 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-426982390 Run Python PostCommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 151135) Time Spent: 2h (was: 1h 50m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 2h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151133=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151133 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 04/Oct/18 11:20 Start Date: 04/Oct/18 11:20 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-426982051 The postcommit error seems to be for the unrelated test_user_score_it. Trying again. Run Python PostCommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 151133) Time Spent: 1h 40m (was: 1.5h) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 1h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151099=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151099 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 04/Oct/18 09:21 Start Date: 04/Oct/18 09:21 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-426947170 Jenkins: Run Python PostCommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 151099) Time Spent: 1h 20m (was: 1h 10m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151100=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151100 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 04/Oct/18 09:22 Start Date: 04/Oct/18 09:22 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-426947354 Run Python PostCommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 151100) Time Spent: 1.5h (was: 1h 20m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 1.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151086=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151086 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 04/Oct/18 09:00 Start Date: 04/Oct/18 09:00 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-426940375 Jeknins: Run Python PostCommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 151086) Time Spent: 1h 10m (was: 1h) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151080=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151080 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 04/Oct/18 08:45 Start Date: 04/Oct/18 08:45 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-426935761 Run Python PostCommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 151080) Time Spent: 1h (was: 50m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[
https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=151079=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151079
]
ASF GitHub Bot logged work on BEAM-2887:
Author: ASF GitHub Bot
Created on: 04/Oct/18 08:44
Start Date: 04/Oct/18 08:44
Worklog Time Spent: 10m
Work Description: robertwb commented on a change in pull request #6504:
[BEAM-2887] Remove special FnApi version of wordcount.
URL: https://github.com/apache/beam/pull/6504#discussion_r222584017
##
File path: sdks/python/apache_beam/examples/wordcount_it_test.py
##
@@ -45,6 +44,13 @@ class WordCountIT(unittest.TestCase):
@attr('IT')
def test_wordcount_it(self):
+self._run_wordcount_it()
+
+ @attr('IT', 'ValidatesContainer')
+ def test_wordcount_fnapi_it(self):
+self._run_wordcount_it(experiment='beam_fn_api')
+
+ def _run_wordcount_it(self, **opts):
Review comment:
Oh, yes, this was completely lost in the refactor. Thanks for catching this!
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 151079)
Time Spent: 50m (was: 40m)
> Python SDK support for portable pipelines
> -
>
> Key: BEAM-2887
> URL: https://issues.apache.org/jira/browse/BEAM-2887
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
>Reporter: Henning Rohde
>Assignee: Ahmet Altay
>Priority: Major
> Labels: portability
> Time Spent: 50m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[
https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=150467=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-150467
]
ASF GitHub Bot logged work on BEAM-2887:
Author: ASF GitHub Bot
Created on: 02/Oct/18 17:17
Start Date: 02/Oct/18 17:17
Worklog Time Spent: 10m
Work Description: aaltay commented on a change in pull request #6504:
[BEAM-2887] Remove special FnApi version of wordcount.
URL: https://github.com/apache/beam/pull/6504#discussion_r222038387
##
File path: sdks/python/apache_beam/examples/wordcount_it_test.py
##
@@ -45,6 +44,13 @@ class WordCountIT(unittest.TestCase):
@attr('IT')
def test_wordcount_it(self):
+self._run_wordcount_it()
+
+ @attr('IT', 'ValidatesContainer')
+ def test_wordcount_fnapi_it(self):
+self._run_wordcount_it(experiment='beam_fn_api')
+
+ def _run_wordcount_it(self, **opts):
Review comment:
Where is `opts` is used? I am not sure how experiment is passed down.
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 150467)
Time Spent: 40m (was: 0.5h)
> Python SDK support for portable pipelines
> -
>
> Key: BEAM-2887
> URL: https://issues.apache.org/jira/browse/BEAM-2887
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
>Reporter: Henning Rohde
>Assignee: Ahmet Altay
>Priority: Major
> Labels: portability
> Time Spent: 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=150319=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-150319 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 02/Oct/18 09:16 Start Date: 02/Oct/18 09:16 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-426205517 R: @aaltay This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 150319) Time Spent: 0.5h (was: 20m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=148771=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-148771 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 27/Sep/18 14:53 Start Date: 27/Sep/18 14:53 Worklog Time Spent: 10m Work Description: robertwb commented on issue #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504#issuecomment-425123358 Run Python PostCommit This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 148771) Time Spent: 20m (was: 10m) > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >Reporter: Henning Rohde >Assignee: Ahmet Altay >Priority: Major > Labels: portability > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-2887) Python SDK support for portable pipelines
[ https://issues.apache.org/jira/browse/BEAM-2887?focusedWorklogId=148769=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-148769 ] ASF GitHub Bot logged work on BEAM-2887: Author: ASF GitHub Bot Created on: 27/Sep/18 14:52 Start Date: 27/Sep/18 14:52 Worklog Time Spent: 10m Work Description: robertwb opened a new pull request #6504: [BEAM-2887] Remove special FnApi version of wordcount. URL: https://github.com/apache/beam/pull/6504 The "standard" wordcount now runs on FnApi, use that for integration testing. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). It will help us expedite review of your Pull Request if you tag someone (e.g. `@username`) to look at it. Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | --- Java | [](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/) Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/) | --- | --- | --- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 148769) Time Spent: 10m Remaining Estimate: 0h > Python SDK support for portable pipelines > - > > Key: BEAM-2887 > URL: https://issues.apache.org/jira/browse/BEAM-2887 > Project: Beam > Issue Type: Improvement > Components: sdk-py-core >
