Neville Li created BEAM-7922: -------------------------------- Summary: Storage API reads in BigQueryTableProvider Key: BEAM-7922 URL: https://issues.apache.org/jira/browse/BEAM-7922 Project: Beam Issue Type: Improvement Components: dsl-sql Reporter: Neville Li Fix For: 2.14.0
Looks like {{BigQueryTable.buildIOReader}} is reading the entire table. It could probably be optimized to use BigQuery Storage API with `withReadOptions` and infer "selected fileds" column projection from {{Schema}}? -- This message was sent by Atlassian JIRA (v7.6.14#76016)