Vandana Yadav created CARBONDATA-1945:
-----------------------------------------
Summary: documentation for bad records action needs to be updated
Key: CARBONDATA-1945
URL: https://issues.apache.org/jira/browse/CARBONDATA-1945
Project: CarbonData
Issue Type: Improvement
Components: docs
Affects Versions: 1.3.0
Environment: spark 2.1
Reporter: Vandana Yadav
Assignee: Vandana Yadav
Priority: Trivial
Attachments: 2000_UniqData.csv
We should update bad record action's default value as while creating and
loading data with some empty or bad record it is giving exception
Error: java.lang.Exception: Data load failed due to bad record:
Steps to reproduce:
1) Create Table:
CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string,
DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2
bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2
decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"=
"256 MB")
2) Load data:
LOAD DATA inpath 'hdfs://localhost:54310/Data/uniqdata/2000_UniqData.csv' INTO
table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME,
ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1,
DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2,
INTEGER_COLUMN1','TIMESTAMPFORMAT'='yyyy-MM-dd HH:mm:ss');
3) Output:
Expected output: data should be loaded successfully.
Actual Output: Error: java.lang.Exception: Data load failed due to bad record:
The value with column name dob and column data type TIMESTAMP is not a valid
TIMESTAMP type. (state=,code=0)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
