[
https://issues.apache.org/jira/browse/BEAM-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kirill Kozlov updated BEAM-9358:
--------------------------------
Description:
There is a drastic decrease in Megabytes/second write speeds (from ~50 to ~5)
[1], as well as 10x increase in runtime [2] for python BigQueryIO in the
PerfKit dashboard.
Seems to be fairly recent, started on the Feb 20th and continued on the Feb
21st. Maybe a flake, but still worth investigating.
[1]
[https://apache-beam-testing.appspot.com/explore?dashboard=5667383922393088&widget=1939451611&container=847031938]
[2]
[https://apache-beam-testing.appspot.com/explore?dashboard=5667383922393088&widget=2088160722&container=15365888]
was:
There is a drastic decrease in Megabytes/second write speeds (from ~50 to ~5),
as well as 10x increase in runtime [2] for python BigQueryIO in the PerfKit
dashboard [1].
Seems to be fairly recent, started on the Feb 20th and continued on the Feb
21st. Maybe a flake, but still worth investigating.
[1]
[https://apache-beam-testing.appspot.com/explore?dashboard=5667383922393088&widget=1939451611&container=847031938]
[2]
[https://apache-beam-testing.appspot.com/explore?dashboard=5667383922393088&widget=2088160722&container=15365888]
> BigQueryIO potential write speed regression
> -------------------------------------------
>
> Key: BEAM-9358
> URL: https://issues.apache.org/jira/browse/BEAM-9358
> Project: Beam
> Issue Type: Task
> Components: io-py-gcp
> Affects Versions: 2.19.0
> Reporter: Kirill Kozlov
> Priority: Minor
>
> There is a drastic decrease in Megabytes/second write speeds (from ~50 to ~5)
> [1], as well as 10x increase in runtime [2] for python BigQueryIO in the
> PerfKit dashboard.
> Seems to be fairly recent, started on the Feb 20th and continued on the Feb
> 21st. Maybe a flake, but still worth investigating.
> [1]
> [https://apache-beam-testing.appspot.com/explore?dashboard=5667383922393088&widget=1939451611&container=847031938]
> [2]
> [https://apache-beam-testing.appspot.com/explore?dashboard=5667383922393088&widget=2088160722&container=15365888]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
