[ https://issues.apache.org/jira/browse/BEAM-12482?focusedWorklogId=756636&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-756636 ]
ASF GitHub Bot logged work on BEAM-12482: ----------------------------------------- Author: ASF GitHub Bot Created on: 13/Apr/22 19:33 Start Date: 13/Apr/22 19:33 Worklog Time Spent: 10m Work Description: asf-ci commented on PR #17365: URL: https://github.com/apache/beam/pull/17365#issuecomment-1098408893 Can one of the admins verify this patch? Issue Time Tracking ------------------- Worklog Id: (was: 756636) Time Spent: 4h 50m (was: 4h 40m) > BigQueryIO failed to load data to temp table when withSchemaUpdateOptions is > set. > --------------------------------------------------------------------------------- > > Key: BEAM-12482 > URL: https://issues.apache.org/jira/browse/BEAM-12482 > Project: Beam > Issue Type: Bug > Components: io-java-gcp > Reporter: Siyuan Chen > Assignee: Marco Robles > Priority: P2 > Time Spent: 4h 50m > Remaining Estimate: 0h > > `withSchemaUpdateOptions` is only supported with WRITE_APPEND or > WRITE_TRUNCATE with paritioned table. This is noted in the documentation: > [https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L1965] > When the temp files are spilt to multiple load jobs, the write disposition is > set to WRITE_TRUNCATE for the temporary tables in favor of retries. > [https://github.com/apache/beam/blob/a8a8b3ab1292ff408940ba4430c95bc754341589/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L219] > And the loading would fail with error > "Schema update options should only be specified with WRITE_APPEND > disposition, or with WRITE_TRUNCATE disposition on a table partition." > -- This message was sent by Atlassian Jira (v8.20.1#820001)