Getting some errors when attempting to create Parquet files from CSV data, and trying to determine if it is due to the format of the source data.

Its a fairly simple format of "datetime,key,key,key,numeric,numeric,numeric, ..." with 32 of those numeric columns in total.

The source data does contain a lot missing values for the numeric columns, and those are represented by as consecutive delimiters: ""datetime,key,key,key,numeric,,,,,,..."

Could this be causing the CTAS to fail with these types of errors? Or is there another cause to look for?

~~~
Error: SYSTEM ERROR: IllegalArgumentException: length: -260 (expected: >= 0) │······························································· │·······························································
Fragment 1:2
~~~

Reply via email to