Yahui Liu created CARBONDATA-4157: ------------------------------------- Summary: load data timestamp data didn't consider daylight saving time Key: CARBONDATA-4157 URL: https://issues.apache.org/jira/browse/CARBONDATA-4157 Project: CarbonData Issue Type: Bug Components: data-load Affects Versions: 2.1.0 Reporter: Yahui Liu
# prepare one txt file contains 1 time data in daylight saving time, for example "1991-08-12 00:00:00" # upload the file to one hdfs folder, for example /tmp/test_time # create carbon table: create table test_time(t timestamp) stored as carbondata; # create one external txt table with location to the data file folder: create table test_time_txt(t timestamp) location '/tmp/test_time'; # insert the data in txt table into carbon table: insert into test_time select * from test_time_txt; then query carbon table, result is: # +------------------------+ | t | +------------------------+ | 1991-08-12 01:00:00.0 | +------------------------+ # load data directly into carbon table: load data inpath '/tmp/test_time' into table test_time options('fileheader'='t'); then query carbon table, result is: # +------------------------+ | t | +------------------------+ | 1991-08-12 00:00:00.0 | +------------------------+ # same data file, insert into and load data give different result, and because "1991-08-12 00:00:00" is in daylight saving time, so most of the file format give "1991-08-12 01:00:00" as the result. -- This message was sent by Atlassian Jira (v8.3.4#803005)