Lukasz Gajowy created BEAM-6291:
-----------------------------------
Summary: Make the schema for BQ tables storing metric results more
generic (Python)
Key: BEAM-6291
URL: https://issues.apache.org/jira/browse/BEAM-6291
Project: Beam
Issue Type: Sub-task
Components: testing
Reporter: Lukasz Gajowy
Assignee: Kasia Kucharczyk
Currently, we keep the metrics results in BQ in tables with a schema like this:
timestamp | total_bytes | run_time | (possibly other BQ columns)
every time we want to add a new column the schema has to be extended. This is
not convenient given the fact that any load test can have different metrics
stored. This in turn would cause multiple BQ tables each queried differently.
We can provide a more generic schema, like so:
test_id | timestamp | metric | value
thanks to that, every metric, whatever it's name is, can be saved in the table
as a separate row. This gives more elasticity in storing metrics and is still
easy to query and plot.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
