[
https://issues.apache.org/jira/browse/BEAM-5707?focusedWorklogId=153363&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-153363
]
ASF GitHub Bot logged work on BEAM-5707:
----------------------------------------
Author: ASF GitHub Bot
Created on: 11/Oct/18 01:50
Start Date: 11/Oct/18 01:50
Worklog Time Spent: 10m
Work Description: tweise commented on a change in pull request #6637:
[BEAM-5707] Add a periodic, streaming impulse source for Flink portable
pipelines
URL: https://github.com/apache/beam/pull/6637#discussion_r224292672
##########
File path:
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/PTransformTranslation.java
##########
@@ -63,6 +64,8 @@
public static final String GROUP_BY_KEY_TRANSFORM_URN =
getUrn(StandardPTransforms.Primitives.GROUP_BY_KEY);
public static final String IMPULSE_TRANSFORM_URN =
getUrn(StandardPTransforms.Primitives.IMPULSE);
+ public static final String STREAMING_IMPULSE_TRANSFORM_URL =
"flink:transform:streaming_impulse:v1";
Review comment:
It isn't necessary to modify this class. The URL is Flink runner specific
and should live with the Flink runner.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 153363)
Time Spent: 50m (was: 40m)
> Add a portable Flink streaming synthetic source for testing
> -----------------------------------------------------------
>
> Key: BEAM-5707
> URL: https://issues.apache.org/jira/browse/BEAM-5707
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Reporter: Micah Wylde
> Assignee: Aljoscha Krettek
> Priority: Minor
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Currently there are no built-in streaming sources for portable pipelines.
> This makes it hard to test streaming functionality in the Python SDK.
> It would be very useful to add a periodic impulse source that (with some
> configurable frequency) outputs an empty byte array, which can then be
> transformed as desired inside the python pipeline. More context in this
> [mailing list
> discussion|https://lists.apache.org/thread.html/b44a648ab1d0cb200d8bfe4b280e9dad6368209c4725609cbfbbe410@%3Cdev.beam.apache.org%3E].
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
