Re: [I] Change SQL to GCS operators default row group size when output is Parquet [airflow]

eladkal closed issue #36793: Change SQL to GCS operators default row group size when output is Parquet URL: https://github.com/apache/airflow/issues/36793 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [I] Change SQL to GCS operators default row group size when output is Parquet [airflow]

renzepost commented on issue #36793: URL: https://github.com/apache/airflow/issues/36793#issuecomment-1893253889 @Taragolis you can assign this to me! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] Change SQL to GCS operators default row group size when output is Parquet [airflow]

Taragolis commented on issue #36793: URL: https://github.com/apache/airflow/issues/36793#issuecomment-1892614742 > I'm not sure what would be a good default setting instead for this Airflow operator. That is a very difficult question which value should be default, my personal thought

[I] Change SQL to GCS operators default row group size when output is Parquet [airflow]

renzepost opened a new issue, #36793: URL: https://github.com/apache/airflow/issues/36793 ### Description When using an operator that is derived from `BaseSQLToGCSOperator` with `output_format=parquet`, the default `parquet_row_group_size` is 1. This seems like a very strange default