vvysotskyi commented on issue #2746: URL: https://github.com/apache/drill/issues/2746#issuecomment-1412711824
The UDF that doesn't work when this option is enabled is `CONVERT_FROM(timestamp_field, 'TIMESTAMP_IMPALA')`, and it doesn't work because the `timestamp_field` type becomes timestamp instead of binary, and it is expected behavior, no need to fix it. Details regarding this option can be found here: https://drill.apache.org/docs/parquet-format/#about-int96-support Side note: `INT96` parquet physical type is deprecated, not only the usage for timestamps. There are a lot of cases when such data could be passed to Drill. The good news is that regardless of the option value, Drill doesn't write this type, it only reads it and interprets data as timestamp values instead of binary when the option is enabled. So I think that enabling the option (and possibly keeping behavior in sync with Spark and other tools) will only improve the user experience. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
