Re: [Question] Does Apache SnowflakeIO support Apache Parquet?
Hello, The reason why is that Parquet can help user reduce the storage requirement, please refer to below and here is the link https://www.databricks.com/glossary/what-is-parquet. Any response would be appreciated. Thank you. [image: image.png] Regards, Xinmin On Tue, Mar 5, 2024 at 1:08 PM Wiśniowski Piotr < contact.wisniowskipi...@gmail.com> wrote: > Hi Xinmin, > > After quick look at the connection in java it seems that the csv format > was an explicit decision. As this is entirely transparent to user I am just > curious why would You like to use parquet instead? What do you want to > achieve? > > Regards, > > Wiśniowski Piotr > On 5.03.2024 05:47, Xinmin wrote: > > Hello guru, > > We would like to write data to Snowflake with S3 bucket, basically, the > connector uploads the file in the CSV format to S3 bucket before copying > data into the table. Please refer to below. > > [image: image.png] > > Do you have any plans to support Apache Parquet? Thanks. > > Regards, > Xinmin > >
Re: [Question] Does Apache SnowflakeIO support Apache Parquet?
Hi Xinmin, After quick look at the connection in java it seems that the csv format was an explicit decision. As this is entirely transparent to user I am just curious why would You like to use parquet instead? What do you want to achieve? Regards, Wiśniowski Piotr On 5.03.2024 05:47, Xinmin wrote: Hello guru, We would like to write data to Snowflake with S3 bucket, basically, the connector uploads the file in the CSV format to S3 bucket before copying data into the table. Please refer to below. image.png Do you have any plans to support Apache Parquet? Thanks. Regards, Xinmin
[Question] Does Apache SnowflakeIO support Apache Parquet?
Hello guru, We would like to write data to Snowflake with S3 bucket, basically, the connector uploads the file in the CSV format to S3 bucket before copying data into the table. Please refer to below. [image: image.png] Do you have any plans to support Apache Parquet? Thanks. Regards, Xinmin