davlee1972 commented on issue #28303: URL: https://github.com/apache/arrow/issues/28303#issuecomment-2088922037
This is still an issue.. It also extends to time32[s].. **CSV conversion error to time32[s]: invalid value '7:55:00'** Right now the timestamp_parser will only convert different string formats to timestamp[x] types.. If you have a schema column with date32, date64 or time32 then the CSV conversion will fail. Your date column in the CSV has to be in YYYY-MM-DD HH:MM:SS format or it will fail.. There is no alternative format.. The solution is to allow the format lists in timestamp_parser to apply to date32, date64, time32 columns.. or create date_parser and time_parser options.. I have a current hack I implemented to be able to parse DATEs out of CSV files.. If the schema being used to read a CSV file has any column data types that start with "DATE".. Change the schema column to timestamp[s]. Read the CSV file which will read the date columns in as timestamps.. Convert the timestamp[s] columns of the result back to date32/64[day] using pyarrow.compute.cast(). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
