To add onto Antoine's two points:
1. expressing the semantics (and perhaps enforcing them, e.g. return an
>error when an addition gives a result out of bounds)
There was a proposed extension type to capture Range/Interval (
https://issues.apache.org/jira/browse/ARROW-12637). I can imagine ha
On Tue, Jun 22, 2021 at 12:27 PM Antoine Pitrou wrote:
> On Mon, 21 Jun 2021 23:50:29 -0400
> Ying Zhou wrote:
> > Hi,
> >
> > In data people use there are often bounded numbers, mostly integers with
> clear and fixed upper and lower bounds but also decimals and floats as well
> e.g. test scores
If you need to use them in an application that is built on Arrow and
Parquet, you can certainly implement an Arrow extension type (on top
of FixedSizeBinary in Arrow, for example).
On Tue, Jun 22, 2021 at 5:27 AM Antoine Pitrou wrote:
>
> On Mon, 21 Jun 2021 23:50:29 -0400
> Ying Zhou wrote:
> >
On Mon, 21 Jun 2021 23:50:29 -0400
Ying Zhou wrote:
> Hi,
>
> In data people use there are often bounded numbers, mostly integers with
> clear and fixed upper and lower bounds but also decimals and floats as well
> e.g. test scores, numerous codes in older databases, max temperature of a
> cit
Hi,
In data people use there are often bounded numbers, mostly integers with clear
and fixed upper and lower bounds but also decimals and floats as well e.g. test
scores, numerous codes in older databases, max temperature of a city,
latitudes, longitudes, numerous IDs etc. I wonder whether we s
