SOURYAKANTA DWIVEDY created CARBONDATA-626:
----------------------------------------------
Summary: [Dataload] Dataloading is not working with delimiter set
as "|"
Key: CARBONDATA-626
URL: https://issues.apache.org/jira/browse/CARBONDATA-626
Project: CarbonData
Issue Type: Bug
Components: data-load
Affects Versions: 1.0.0-incubating
Environment: 3 node cluster
Reporter: SOURYAKANTA DWIVEDY
Description : Data loading fail with delimiter as "|" .
Steps:
> 1. Create table
> 2. Load data into table
Log :-
---------
- create table DIM_TERMINAL
(
ID int,
TAC String,
TER_BRAND_NAME String,
TER_MODEL_NAME String,
TER_MODENAME String,
TER_TYPE_ID String,
TER_TYPE_NAME_EN String,
TER_TYPE_NAME_CHN String,
TER_OSTYPE String,
TER_OS_TYPE_NAME String,
HSPASPEED String,
LTESPEED String,
VOLTE_FLAG String,
flag String
) stored by 'org.apache.carbondata.format' TBLPROPERTIES
('DICTIONARY_INCLUDE'='TAC,TER_BRAND_NAME,TER_MODEL_NAME,TER_MODENAME,TER_TYPE_ID,TER_TYPE_NAME_EN,TER_TYPE_NAME_CHN,TER_OSTYPE,TER_OS_TYPE_NAME,HSPASPEED,LTESPEED,VOLTE_FLAG,flag');
- jdbc:hive2://172.168.100.212:23040> LOAD DATA inpath
'hdfs://hacluster/SEQIQ/IQ_DIM_TERMINAL.csv' INTO table DIM_TERMINAL1
OPTIONS('DELIMITER'='|','USE_KETTLE'='false','QUOTECHAR'='','FILEHEADER'=
'ID,TAC,TER_BRAND_NAME,TER_MODEL_NAME,TER_MODENAME,TER_TYPE_ID,TER_TYPE_NAME_EN,TER_TYPE_NAME_CHN,TER_OSTYPE,TER_OS_TYPE_NAME,HSPASPEED,LTESPEED,VOLTE_FLAG,flag');
Error: java.lang.RuntimeException: Data loading failed. table not found:
default.dim_terminal1 (state=,code=0)
0: jdbc:hive2://172.168.100.212:23040> LOAD DATA inpath
'hdfs://hacluster/SEQIQ/IQ_DIM_TERMINAL1.csv' INTO table DIM_TERMINAL
OPTIONS('DELIMITER'='|','USE_KETTLE'='false','QUOTECHAR'='','FILEHEADER'=
'ID,TAC,TER_BRAND_NAME,TER_MODEL_NAME,TER_MODENAME,TER_TYPE_ID,TER_TYPE_NAME_EN,TER_TYPE_NAME_CHN,TER_OSTYPE,TER_OS_TYPE_NAME,HSPASPEED,LTESPEED,VOLTE_FLAG,flag');
Error: org.apache.spark.sql.AnalysisException: Reference 'D' is ambiguous,
could be: D#4893, D#4907, D#4920, D#4935, D#4952, D#5025, D#5034.;
(state=,code=0)
- csv raw details :
103880|99000537|MI|2S H1SC 3C|2G/3G|0|SmartPhone|SmartPhone|4|Android|||1|
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
