SOURYAKANTA DWIVEDY created CARBONDATA-626: ----------------------------------------------
Summary: [Dataload] Dataloading is not working with delimiter set as "|" Key: CARBONDATA-626 URL: https://issues.apache.org/jira/browse/CARBONDATA-626 Project: CarbonData Issue Type: Bug Components: data-load Affects Versions: 1.0.0-incubating Environment: 3 node cluster Reporter: SOURYAKANTA DWIVEDY Description : Data loading fail with delimiter as "|" . Steps: > 1. Create table > 2. Load data into table Log :- --------- - create table DIM_TERMINAL ( ID int, TAC String, TER_BRAND_NAME String, TER_MODEL_NAME String, TER_MODENAME String, TER_TYPE_ID String, TER_TYPE_NAME_EN String, TER_TYPE_NAME_CHN String, TER_OSTYPE String, TER_OS_TYPE_NAME String, HSPASPEED String, LTESPEED String, VOLTE_FLAG String, flag String ) stored by 'org.apache.carbondata.format' TBLPROPERTIES ('DICTIONARY_INCLUDE'='TAC,TER_BRAND_NAME,TER_MODEL_NAME,TER_MODENAME,TER_TYPE_ID,TER_TYPE_NAME_EN,TER_TYPE_NAME_CHN,TER_OSTYPE,TER_OS_TYPE_NAME,HSPASPEED,LTESPEED,VOLTE_FLAG,flag'); - jdbc:hive2://172.168.100.212:23040> LOAD DATA inpath 'hdfs://hacluster/SEQIQ/IQ_DIM_TERMINAL.csv' INTO table DIM_TERMINAL1 OPTIONS('DELIMITER'='|','USE_KETTLE'='false','QUOTECHAR'='','FILEHEADER'= 'ID,TAC,TER_BRAND_NAME,TER_MODEL_NAME,TER_MODENAME,TER_TYPE_ID,TER_TYPE_NAME_EN,TER_TYPE_NAME_CHN,TER_OSTYPE,TER_OS_TYPE_NAME,HSPASPEED,LTESPEED,VOLTE_FLAG,flag'); Error: java.lang.RuntimeException: Data loading failed. table not found: default.dim_terminal1 (state=,code=0) 0: jdbc:hive2://172.168.100.212:23040> LOAD DATA inpath 'hdfs://hacluster/SEQIQ/IQ_DIM_TERMINAL1.csv' INTO table DIM_TERMINAL OPTIONS('DELIMITER'='|','USE_KETTLE'='false','QUOTECHAR'='','FILEHEADER'= 'ID,TAC,TER_BRAND_NAME,TER_MODEL_NAME,TER_MODENAME,TER_TYPE_ID,TER_TYPE_NAME_EN,TER_TYPE_NAME_CHN,TER_OSTYPE,TER_OS_TYPE_NAME,HSPASPEED,LTESPEED,VOLTE_FLAG,flag'); Error: org.apache.spark.sql.AnalysisException: Reference 'D' is ambiguous, could be: D#4893, D#4907, D#4920, D#4935, D#4952, D#5025, D#5034.; (state=,code=0) - csv raw details : 103880|99000537|MI|2S H1SC 3C|2G/3G|0|SmartPhone|SmartPhone|4|Android|||1| -- This message was sent by Atlassian JIRA (v6.3.4#6332)