Andrew Pilloud created BEAM-10117: ------------------------------------- Summary: BigQuery IO race results in erroneous "Job failed." message Key: BEAM-10117 URL: https://issues.apache.org/jira/browse/BEAM-10117 Project: Beam Issue Type: Bug Components: io-java-gcp Reporter: Andrew Pilloud
BigQuery IO prints out a "Job failed. retrying." if the job hasn't finished starting by the time we query the status of the job. This leads to customer confusion. https://github.com/apache/beam/blame/2a4092dfb8c46408818402b1c4a09a8cd44e907a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryHelpers.java#L140 {code:java} 2020-05-26T14:14:21.357Z Job beam_load_..._00001_00000-0 failed. retrying. 2020-05-26T14:14:22.974Z job beam_load_..._00001_00000-0 started 2020-05-26T14:14:59.829Z Job beam_load_..._00001_00000-0 completed successfully. {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)