HuaHuaY opened a new pull request, #47427:
URL: https://github.com/apache/arrow/pull/47427

   ### Rationale for this change
   As described in #44345, `Decimal32`/`Decimal64` have been implemented but 
Parquet has poor support. This change allows to write `Decimal32`/`Decimal64` 
into Parquet file the same way as `Decimal128`/`Decimal256` and to read 
`Decimal32`/`Decimal64` from an existed Parquet file.
   
   ### What changes are included in this PR?
   1. Support writing `Decimal32`/`Decimal64` as 
`INT32`/`INT64`/`BYTE_ARRAY`/`FIXED_LEN_BYTE_ARRAY` into Parquet file.
   2. Support reading Parquet column with logical type Decimal. Either reading 
type from metadata or infering Arrow Decimal type is supported.
   
   ### Are these changes tested?
   Yes.
   
   ### Are there any user-facing changes?
   Yes. A flag named `smallest_decimal_enabled_` is added in 
`ArrowReaderProperties`. To maintain backward compatibility, only when the flag 
is `true`, Arrow will infer Decimal with small precision to 
`Decimal32`/`Decimal64`.
   
   - GitHub Issue: #44345


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to