dev@carbondata.apache.org

2020-07-15 Thread Kumar Vishal
Hi, I agree with Ravi, first we need to come up with solution how to store till nano/mico second in carbon. Then changing the formatter will be useful for us. Regards Kumar Vishal On Wed, 15 Jul 2020 at 6:18 PM, Ravindra Pesala wrote: > Hi, > > I think it is bigger than just changing to DateTim

dev@carbondata.apache.org

2020-07-15 Thread Ravindra Pesala
Hi, I think it is bigger than just changing to DateTimeFormatter. As of now, carbon uses only 64 bit to store timestamp so it can accommodate till milliseconds. In order to support till nanoseconds, we need to use 96 bits. If you check spark-parquet it uses 96 bits to store timestamp. It would be