quentin-sommer commented on PR #27052: URL: https://github.com/apache/airflow/pull/27052#issuecomment-1341679823
Hi, I tracked an issue I have to this pr: ``` def _check_schema_fields(self, table_resource): ``` (https://github.com/apache/airflow/pull/27052/files#diff-875bf3d1bfbba7067dc754732c0e416b8ebe7a5b722bc9ac428b98934f04a16fR512) is executed and try to infer a schema on my newline delimited json file. It obviously doesn't work, I end up with column names containing `{"`. I'm trying to understand why the function is called on all the data types without checking if `source_format` is `'CSV'`. Maybe I'm just using it wrong? Hope you can help I could provide the `schema_fields` every time to make the operator bypass the check but it was convenient to let bigquery detect the schema. ping @VladaZakharova and @potiuk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
