[ https://issues.apache.org/jira/browse/BEAM-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uwe Jugel updated BEAM-1923: ---------------------------- Description: When reading from BigQuery using the Python SDK, the SDK prints a WARNING: "Dataset does not exist so we will create it." I like to improve that: - showing that it is a temporary data set - showing the dataset name This is useful if the pipeline fails, since the temporary dataset will then be left undeleted in your project. I created a branch for the fix here: https://github.com/apache/beam/compare/master...ubunatic:temp-table-log-message and opened a PR here: https://github.com/apache/beam/pull/2480 was: When reading from BigQuery using the Python SDK, the SDK prints a WARNING: "Dataset does not exist so we will create it." I like to improve that: - showing that it is a temporary data set - showing the dataset name This is useful if the pipeline fails, since the temporary dataset will then be left undeleted in your project. I created a branch for the fix here: https://github.com/apache/beam/compare/master...ubunatic:temp-table-log-message > Improve python log messages for temporary BigQuery tables > --------------------------------------------------------- > > Key: BEAM-1923 > URL: https://issues.apache.org/jira/browse/BEAM-1923 > Project: Beam > Issue Type: Improvement > Components: sdk-py > Reporter: Uwe Jugel > Assignee: Ahmet Altay > Priority: Trivial > > When reading from BigQuery using the Python SDK, the SDK prints a WARNING: > "Dataset does not exist so we will create it." > I like to improve that: > - showing that it is a temporary data set > - showing the dataset name > This is useful if the pipeline fails, since the temporary dataset will then > be left undeleted in your project. > I created a branch for the fix here: > https://github.com/apache/beam/compare/master...ubunatic:temp-table-log-message > and opened a PR here: https://github.com/apache/beam/pull/2480 -- This message was sent by Atlassian JIRA (v6.3.15#6346)