[
https://issues.apache.org/jira/browse/BEAM-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kasia Kucharczyk updated BEAM-6335:
-----------------------------------
Description:
Uses prepared Java Data Insertion Pipeline to update GroupByKey in Python to
load test streaming.
This task contains following steps:
# Create GroupByKey streaming test that accepts bytes
# To stop test after arrived messages it is required to add a matcher. The
matcher should work on number of messages because in case of load testing it
would be difficult to compare big load of bytes (also casting bytes to string
to compare load would be difficult).
# All data is generated by SyntheticDataPublisher.java, which is sending bytes
produced by synthetic source to PubSub. PubSub is used as a streaming source
for the Python test.
was:Uses prepared Java Data Insertion Pipeline to update GroupByKey in Python
to load test streaming.
> GroupByKey uses data insertion pipeline in streaming tests
> ----------------------------------------------------------
>
> Key: BEAM-6335
> URL: https://issues.apache.org/jira/browse/BEAM-6335
> Project: Beam
> Issue Type: Sub-task
> Components: testing
> Reporter: Kasia Kucharczyk
> Assignee: Kasia Kucharczyk
> Priority: Major
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Uses prepared Java Data Insertion Pipeline to update GroupByKey in Python to
> load test streaming.
> This task contains following steps:
> # Create GroupByKey streaming test that accepts bytes
> # To stop test after arrived messages it is required to add a matcher. The
> matcher should work on number of messages because in case of load testing it
> would be difficult to compare big load of bytes (also casting bytes to string
> to compare load would be difficult).
> # All data is generated by SyntheticDataPublisher.java, which is sending
> bytes produced by synthetic source to PubSub. PubSub is used as a streaming
> source for the Python test.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
