[
https://issues.apache.org/jira/browse/HIVE-25999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amrithaa R G updated HIVE-25999:
--------------------------------
Description:
==========================================================
Issue description:
==========================================================
The hive query "insert overwrite table ..." fails when the number of columns in
a partitioned table is 225 or more .
To repro the issue, after the table creation, some data needs to be loaded into
the temp table. Post this "insert overwrite" command on a partitioned target
table fails with the below error.
PLEASE NOTE: The error will not be reproducible if no data is loaded into the
temp table
Steps to repro is given below.
==========================================================
Error:
==========================================================
ERROR : FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 1 in table
tgt_manycol with
loadPath=hdfs://<hostname>:8020/user/hive/warehouse/tgt_manycol/.hive-staging_hive_2022-02-24_12-13-54_035_1332847469986875236-5/-ext-10000
INFO : Completed executing
command(queryId=hive_20220224121354_c5509257-7d9c-462c-9089-282c758e2b2f); Time
taken: 37.457 seconds
Error: Error while processing statement: FAILED: Execution Error, return code 1
from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 1 in table
tgt_manycol with
loadPath=hdfs://<hostname>:8020/user/hive/warehouse/tgt_manycol/.hive-staging_hive_2022-02-24_12-13-54_035_1332847469986875236-5/-ext-10000
(state=08S01,code=1)
=======================================================
Repro Steps:
=======================================================
Run the following queries in the given order to repro the error:
1) CREATE TABLE tgt_ManyCol_temp (string1 string,int1 int,decimal1
decimal(15,8),double1 double,date1 date,string_out_1 string,string2 string,int2
int,decimal2 decimal(15,8),double2 double,date2 date,string_out_2
string,string3 string,int3 int,decimal3 decimal(15,8),double3 double,date3
date,string_out_3 string,string4 string,int4 int,decimal4 decimal(15,8),double4
double,date4 date,string_out_4 string,string5 string,int5 int,decimal5
decimal,double5 double,date5 date,string_out_5 string,string6 string,int6
int,decimal6 decimal(15,8),double6 double,date6 date,string_out_6
string,string7 string,int7 int,decimal7 decimal(15,8),double7 double,date7
date,string_out_7 string,string8 string,int8 int,decimal8 decimal(15,8),double8
double,date8 date,string_out_8 string,string9 string,int9 int,decimal9
decimal(15,8),double9 double,date9 date,string_out_9 string,string10
string,int10 int,decimal10 decimal(15,8),double10 double,date10
date,string_out_10 string,string11 string,int11 int,decimal11
decimal(15,8),double11 double,date11 date,string_out_11 string,string12
string,int12 int,decimal12 decimal(15,8),double12 double,date12
date,string_out_12 string,string13 string,int13 int,decimal13
decimal(15,8),double13 double,date13 date,string_out_13 string,string14
string,int14 int,decimal14 decimal(15,8),double14 double,date14
date,string_out_14 string,string15 string,int15 int,decimal15
decimal(15,8),double15 double,date15 date,string_out_15 string,string16
string,int16 int,decimal16 decimal(15,8),double16 double,date16
date,string_out_16 string,string17 string,int17 int,decimal17
decimal(15,8),double17 double,date17 date,string_out_17 string,string18
string,int18 int,decimal18 decimal(15,8),double18 double,date18
date,string_out_18 string,string19 string,int19 int,decimal19
decimal(15,8),double19 double,date19 date,string_out_19 string,string20
string,int20 int,decimal20 decimal(15,8),double20 double,date20
date,string_out_20 string,string21 string,int21 int,decimal21
decimal(15,8),double21 double,date21 date,string_out_21 string,string22
string,int22 int,decimal22 decimal(15,8),double22 double,date22
date,string_out_22 string,string23 string,int23 int,decimal23 decimal,double23
double,date23 date,string_out_23 string,string24 string,int24 int,decimal24
decimal(15,8),double24 double,date24 date,string_out_24 string,string25
string,int25 int,decimal25 decimal(15,8),double25 double,date25
date,string_out_25 string,string26 string,int26 int,decimal26
decimal(15,8),double26 double,date26 date,string_out_26 string,string27
string,int27 int,decimal27 decimal(15,8),double27 double,date27
date,string_out_27 string,string28 string,int28 int,decimal28
decimal(15,8),double28 double,date28 date,string_out_28 string,string29
string,int29 int,decimal29 decimal(15,8),double29 double,date29
date,string_out_29 string,string30 string,int30 int,decimal30
decimal(15,8),double30 double,date30 date,string_out_30 string,string31
string,int31 int,decimal31 decimal(15,8),double31 double,date31
date,string_out_31 string,string32 string,int32 int,decimal32
decimal(15,8),double32 double,date32 date,string_out_32 string,string33
string,int33 int,decimal33 decimal(15,8),double33 double,date33
date,string_out_33 string,string34 string,int34 int,decimal34
decimal(15,8),double34 double,date34 date,string_out_34 string,string35
string,int35 int,decimal35 decimal(15,8),double35 double,date35
date,string_out_35 string,string36 string,int36 int,decimal36
decimal(15,8),double36 double,date36 date,string_out_36 string,string37
string,int37 int,decimal37 decimal(15,8),double37 double,date37
date,string_out_37 string,string38 string,int38 int,decimal38
decimal(15,8),double38 double,date38 date,string_out_38 string,string39
string,int39 int,decimal39 decimal(15,8),double39 double,date39
date,string_out_39 string,string40 string,int40 int,decimal40
decimal(15,8),double40 double,date40 date,string_out_40 string) ROW FORMAT
DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE;
2) load data local in path '<file_path>' into table tgt_ManyCol_temp;
3) CREATE TABLE tgt_ManyCol (string1 string,int1 int,decimal1
decimal(15,8),double1 double,date1 date,string_out_1 string,string2 string,int2
int,decimal2 decimal(15,8),double2 double,date2 date,string_out_2
string,string3 string,int3 int,decimal3 decimal(15,8),double3 double,date3
date,string_out_3 string,string4 string,int4 int,decimal4 decimal(15,8),double4
double,date4 date,string_out_4 string,string5 string,int5 int,decimal5
decimal,double5 double,date5 date,string_out_5 string,string6 string,int6
int,decimal6 decimal(15,8),double6 double,date6 date,string_out_6
string,string7 string,int7 int,decimal7 decimal(15,8),double7 double,date7
date,string_out_7 string,string8 string,int8 int,decimal8 decimal(15,8),double8
double,date8 date,string_out_8 string,string9 string,int9 int,decimal9
decimal(15,8),double9 double,date9 date,string_out_9 string,string10
string,int10 int,decimal10 decimal(15,8),double10 double,date10
date,string_out_10 string,string11 string,int11 int,decimal11
decimal(15,8),double11 double,date11 date,string_out_11 string,string12
string,int12 int,decimal12 decimal(15,8),double12 double,date12
date,string_out_12 string,string13 string,int13 int,decimal13
decimal(15,8),double13 double,date13 date,string_out_13 string,string14
string,int14 int,decimal14 decimal(15,8),double14 double,date14
date,string_out_14 string,string15 string,int15 int,decimal15
decimal(15,8),double15 double,date15 date,string_out_15 string,string16
string,int16 int,decimal16 decimal(15,8),double16 double,date16
date,string_out_16 string,string17 string,int17 int,decimal17
decimal(15,8),double17 double,date17 date,string_out_17 string,string18
string,int18 int,decimal18 decimal(15,8),double18 double,date18
date,string_out_18 string,string19 string,int19 int,decimal19
decimal(15,8),double19 double,date19 date,string_out_19 string,string20
string,int20 int,decimal20 decimal(15,8),double20 double,date20
date,string_out_20 string,string21 string,int21 int,decimal21
decimal(15,8),double21 double,date21 date,string_out_21 string,string22
string,int22 int,decimal22 decimal(15,8),double22 double,date22
date,string_out_22 string,string23 string,int23 int,decimal23 decimal,double23
double,date23 date,string_out_23 string,string24 string,int24 int,decimal24
decimal(15,8),double24 double,date24 date,string_out_24 string,string25
string,int25 int,decimal25 decimal(15,8),double25 double,date25
date,string_out_25 string,string26 string,int26 int,decimal26
decimal(15,8),double26 double,date26 date,string_out_26 string,string27
string,int27 int,decimal27 decimal(15,8),double27 double,date27
date,string_out_27 string,string28 string,int28 int,decimal28
decimal(15,8),double28 double,date28 date,string_out_28 string,string29
string,int29 int,decimal29 decimal(15,8),double29 double,date29
date,string_out_29 string,string30 string,int30 int,decimal30
decimal(15,8),double30 double,date30 date,string_out_30 string,string31
string,int31 int,decimal31 decimal(15,8),double31 double,date31
date,string_out_31 string,string32 string,int32 int,decimal32
decimal(15,8),double32 double,date32 date,string_out_32 string,string33
string,int33 int,decimal33 decimal(15,8),double33 double,date33
date,string_out_33 string,string34 string,int34 int,decimal34
decimal(15,8),double34 double,date34 date,string_out_34 string,string35
string,int35 int,decimal35 decimal(15,8),double35 double,date35
date,string_out_35 string,string36 string,int36 int,decimal36
decimal(15,8),double36 double,date36 date,string_out_36 string,string37
string,int37 int,decimal37 decimal(15,8),double37 double,date37
date,string_out_37 string,string38 string,int38 int,decimal38
decimal(15,8),double38 double,date38 date,string_out_38 string,string39
string,int39 int,decimal39 decimal(15,8),double39 double,date39
date,string_out_39 string,string40 string,int40 int,decimal40 decimal(15,8))
partitioned by (double40 double,date40 date,string_out_40 string) ROW FORMAT
DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE;
4) insert overwrite table tgt_ManyCol partition (double40, date40,
string_out_40) select * from tgt_ManyCol_temp;
was:
==========================================================
Issue description:
==========================================================
The hive query "insert overwrite table ..." fails when the number of columns in
a partitioned table is 225 or more .
To repro the issue, after the table creation, some data needs to be loaded into
the temp table. Post this "insert overwrite" command on a partitioned target
table fails with the below error.
Steps to repro is given below.
==========================================================
Error:
==========================================================
ERROR : FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 1 in table
tgt_manycol with
loadPath=hdfs://<hostname>:8020/user/hive/warehouse/tgt_manycol/.hive-staging_hive_2022-02-24_12-13-54_035_1332847469986875236-5/-ext-10000
INFO : Completed executing
command(queryId=hive_20220224121354_c5509257-7d9c-462c-9089-282c758e2b2f); Time
taken: 37.457 seconds
Error: Error while processing statement: FAILED: Execution Error, return code 1
from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 1 in table
tgt_manycol with
loadPath=hdfs://<hostname>:8020/user/hive/warehouse/tgt_manycol/.hive-staging_hive_2022-02-24_12-13-54_035_1332847469986875236-5/-ext-10000
(state=08S01,code=1)
=======================================================
Repro Steps:
=======================================================
Run the following queries in the given order to repro the error:
1) CREATE TABLE tgt_ManyCol_temp (string1 string,int1 int,decimal1
decimal(15,8),double1 double,date1 date,string_out_1 string,string2 string,int2
int,decimal2 decimal(15,8),double2 double,date2 date,string_out_2
string,string3 string,int3 int,decimal3 decimal(15,8),double3 double,date3
date,string_out_3 string,string4 string,int4 int,decimal4 decimal(15,8),double4
double,date4 date,string_out_4 string,string5 string,int5 int,decimal5
decimal,double5 double,date5 date,string_out_5 string,string6 string,int6
int,decimal6 decimal(15,8),double6 double,date6 date,string_out_6
string,string7 string,int7 int,decimal7 decimal(15,8),double7 double,date7
date,string_out_7 string,string8 string,int8 int,decimal8 decimal(15,8),double8
double,date8 date,string_out_8 string,string9 string,int9 int,decimal9
decimal(15,8),double9 double,date9 date,string_out_9 string,string10
string,int10 int,decimal10 decimal(15,8),double10 double,date10
date,string_out_10 string,string11 string,int11 int,decimal11
decimal(15,8),double11 double,date11 date,string_out_11 string,string12
string,int12 int,decimal12 decimal(15,8),double12 double,date12
date,string_out_12 string,string13 string,int13 int,decimal13
decimal(15,8),double13 double,date13 date,string_out_13 string,string14
string,int14 int,decimal14 decimal(15,8),double14 double,date14
date,string_out_14 string,string15 string,int15 int,decimal15
decimal(15,8),double15 double,date15 date,string_out_15 string,string16
string,int16 int,decimal16 decimal(15,8),double16 double,date16
date,string_out_16 string,string17 string,int17 int,decimal17
decimal(15,8),double17 double,date17 date,string_out_17 string,string18
string,int18 int,decimal18 decimal(15,8),double18 double,date18
date,string_out_18 string,string19 string,int19 int,decimal19
decimal(15,8),double19 double,date19 date,string_out_19 string,string20
string,int20 int,decimal20 decimal(15,8),double20 double,date20
date,string_out_20 string,string21 string,int21 int,decimal21
decimal(15,8),double21 double,date21 date,string_out_21 string,string22
string,int22 int,decimal22 decimal(15,8),double22 double,date22
date,string_out_22 string,string23 string,int23 int,decimal23 decimal,double23
double,date23 date,string_out_23 string,string24 string,int24 int,decimal24
decimal(15,8),double24 double,date24 date,string_out_24 string,string25
string,int25 int,decimal25 decimal(15,8),double25 double,date25
date,string_out_25 string,string26 string,int26 int,decimal26
decimal(15,8),double26 double,date26 date,string_out_26 string,string27
string,int27 int,decimal27 decimal(15,8),double27 double,date27
date,string_out_27 string,string28 string,int28 int,decimal28
decimal(15,8),double28 double,date28 date,string_out_28 string,string29
string,int29 int,decimal29 decimal(15,8),double29 double,date29
date,string_out_29 string,string30 string,int30 int,decimal30
decimal(15,8),double30 double,date30 date,string_out_30 string,string31
string,int31 int,decimal31 decimal(15,8),double31 double,date31
date,string_out_31 string,string32 string,int32 int,decimal32
decimal(15,8),double32 double,date32 date,string_out_32 string,string33
string,int33 int,decimal33 decimal(15,8),double33 double,date33
date,string_out_33 string,string34 string,int34 int,decimal34
decimal(15,8),double34 double,date34 date,string_out_34 string,string35
string,int35 int,decimal35 decimal(15,8),double35 double,date35
date,string_out_35 string,string36 string,int36 int,decimal36
decimal(15,8),double36 double,date36 date,string_out_36 string,string37
string,int37 int,decimal37 decimal(15,8),double37 double,date37
date,string_out_37 string,string38 string,int38 int,decimal38
decimal(15,8),double38 double,date38 date,string_out_38 string,string39
string,int39 int,decimal39 decimal(15,8),double39 double,date39
date,string_out_39 string,string40 string,int40 int,decimal40
decimal(15,8),double40 double,date40 date,string_out_40 string) ROW FORMAT
DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE;
2) load data local in path '<file_path>' into table tgt_ManyCol_temp;
3) CREATE TABLE tgt_ManyCol (string1 string,int1 int,decimal1
decimal(15,8),double1 double,date1 date,string_out_1 string,string2 string,int2
int,decimal2 decimal(15,8),double2 double,date2 date,string_out_2
string,string3 string,int3 int,decimal3 decimal(15,8),double3 double,date3
date,string_out_3 string,string4 string,int4 int,decimal4 decimal(15,8),double4
double,date4 date,string_out_4 string,string5 string,int5 int,decimal5
decimal,double5 double,date5 date,string_out_5 string,string6 string,int6
int,decimal6 decimal(15,8),double6 double,date6 date,string_out_6
string,string7 string,int7 int,decimal7 decimal(15,8),double7 double,date7
date,string_out_7 string,string8 string,int8 int,decimal8 decimal(15,8),double8
double,date8 date,string_out_8 string,string9 string,int9 int,decimal9
decimal(15,8),double9 double,date9 date,string_out_9 string,string10
string,int10 int,decimal10 decimal(15,8),double10 double,date10
date,string_out_10 string,string11 string,int11 int,decimal11
decimal(15,8),double11 double,date11 date,string_out_11 string,string12
string,int12 int,decimal12 decimal(15,8),double12 double,date12
date,string_out_12 string,string13 string,int13 int,decimal13
decimal(15,8),double13 double,date13 date,string_out_13 string,string14
string,int14 int,decimal14 decimal(15,8),double14 double,date14
date,string_out_14 string,string15 string,int15 int,decimal15
decimal(15,8),double15 double,date15 date,string_out_15 string,string16
string,int16 int,decimal16 decimal(15,8),double16 double,date16
date,string_out_16 string,string17 string,int17 int,decimal17
decimal(15,8),double17 double,date17 date,string_out_17 string,string18
string,int18 int,decimal18 decimal(15,8),double18 double,date18
date,string_out_18 string,string19 string,int19 int,decimal19
decimal(15,8),double19 double,date19 date,string_out_19 string,string20
string,int20 int,decimal20 decimal(15,8),double20 double,date20
date,string_out_20 string,string21 string,int21 int,decimal21
decimal(15,8),double21 double,date21 date,string_out_21 string,string22
string,int22 int,decimal22 decimal(15,8),double22 double,date22
date,string_out_22 string,string23 string,int23 int,decimal23 decimal,double23
double,date23 date,string_out_23 string,string24 string,int24 int,decimal24
decimal(15,8),double24 double,date24 date,string_out_24 string,string25
string,int25 int,decimal25 decimal(15,8),double25 double,date25
date,string_out_25 string,string26 string,int26 int,decimal26
decimal(15,8),double26 double,date26 date,string_out_26 string,string27
string,int27 int,decimal27 decimal(15,8),double27 double,date27
date,string_out_27 string,string28 string,int28 int,decimal28
decimal(15,8),double28 double,date28 date,string_out_28 string,string29
string,int29 int,decimal29 decimal(15,8),double29 double,date29
date,string_out_29 string,string30 string,int30 int,decimal30
decimal(15,8),double30 double,date30 date,string_out_30 string,string31
string,int31 int,decimal31 decimal(15,8),double31 double,date31
date,string_out_31 string,string32 string,int32 int,decimal32
decimal(15,8),double32 double,date32 date,string_out_32 string,string33
string,int33 int,decimal33 decimal(15,8),double33 double,date33
date,string_out_33 string,string34 string,int34 int,decimal34
decimal(15,8),double34 double,date34 date,string_out_34 string,string35
string,int35 int,decimal35 decimal(15,8),double35 double,date35
date,string_out_35 string,string36 string,int36 int,decimal36
decimal(15,8),double36 double,date36 date,string_out_36 string,string37
string,int37 int,decimal37 decimal(15,8),double37 double,date37
date,string_out_37 string,string38 string,int38 int,decimal38
decimal(15,8),double38 double,date38 date,string_out_38 string,string39
string,int39 int,decimal39 decimal(15,8),double39 double,date39
date,string_out_39 string,string40 string,int40 int,decimal40 decimal(15,8))
partitioned by (double40 double,date40 date,string_out_40 string) ROW FORMAT
DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE;
4) insert overwrite table tgt_ManyCol partition (double40, date40,
string_out_40) select * from tgt_ManyCol_temp;
> INSERT OVERWRITE on partitioned table fails when the number of columns in the
> table is >= 225
> ----------------------------------------------------------------------------------------------
>
> Key: HIVE-25999
> URL: https://issues.apache.org/jira/browse/HIVE-25999
> Project: Hive
> Issue Type: Bug
> Components: Beeline, Hive
> Affects Versions: 3.1.2
> Environment: Amazon EMR 6.4 and Hive 3.1.2
> Reporter: Amrithaa R G
> Priority: Major
> Attachments: Steps to repro.txt
>
>
>
> ==========================================================
> Issue description:
> ==========================================================
> The hive query "insert overwrite table ..." fails when the number of columns
> in a partitioned table is 225 or more .
> To repro the issue, after the table creation, some data needs to be loaded
> into the temp table. Post this "insert overwrite" command on a partitioned
> target table fails with the below error.
> PLEASE NOTE: The error will not be reproducible if no data is loaded into the
> temp table
> Steps to repro is given below.
> ==========================================================
> Error:
> ==========================================================
> ERROR : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 1 in table
> tgt_manycol with
> loadPath=hdfs://<hostname>:8020/user/hive/warehouse/tgt_manycol/.hive-staging_hive_2022-02-24_12-13-54_035_1332847469986875236-5/-ext-10000
> INFO : Completed executing
> command(queryId=hive_20220224121354_c5509257-7d9c-462c-9089-282c758e2b2f);
> Time taken: 37.457 seconds
> Error: Error while processing statement: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 1 in
> table tgt_manycol with
> loadPath=hdfs://<hostname>:8020/user/hive/warehouse/tgt_manycol/.hive-staging_hive_2022-02-24_12-13-54_035_1332847469986875236-5/-ext-10000
> (state=08S01,code=1)
> =======================================================
> Repro Steps:
> =======================================================
> Run the following queries in the given order to repro the error:
> 1) CREATE TABLE tgt_ManyCol_temp (string1 string,int1 int,decimal1
> decimal(15,8),double1 double,date1 date,string_out_1 string,string2
> string,int2 int,decimal2 decimal(15,8),double2 double,date2 date,string_out_2
> string,string3 string,int3 int,decimal3 decimal(15,8),double3 double,date3
> date,string_out_3 string,string4 string,int4 int,decimal4
> decimal(15,8),double4 double,date4 date,string_out_4 string,string5
> string,int5 int,decimal5 decimal,double5 double,date5 date,string_out_5
> string,string6 string,int6 int,decimal6 decimal(15,8),double6 double,date6
> date,string_out_6 string,string7 string,int7 int,decimal7
> decimal(15,8),double7 double,date7 date,string_out_7 string,string8
> string,int8 int,decimal8 decimal(15,8),double8 double,date8 date,string_out_8
> string,string9 string,int9 int,decimal9 decimal(15,8),double9 double,date9
> date,string_out_9 string,string10 string,int10 int,decimal10
> decimal(15,8),double10 double,date10 date,string_out_10 string,string11
> string,int11 int,decimal11 decimal(15,8),double11 double,date11
> date,string_out_11 string,string12 string,int12 int,decimal12
> decimal(15,8),double12 double,date12 date,string_out_12 string,string13
> string,int13 int,decimal13 decimal(15,8),double13 double,date13
> date,string_out_13 string,string14 string,int14 int,decimal14
> decimal(15,8),double14 double,date14 date,string_out_14 string,string15
> string,int15 int,decimal15 decimal(15,8),double15 double,date15
> date,string_out_15 string,string16 string,int16 int,decimal16
> decimal(15,8),double16 double,date16 date,string_out_16 string,string17
> string,int17 int,decimal17 decimal(15,8),double17 double,date17
> date,string_out_17 string,string18 string,int18 int,decimal18
> decimal(15,8),double18 double,date18 date,string_out_18 string,string19
> string,int19 int,decimal19 decimal(15,8),double19 double,date19
> date,string_out_19 string,string20 string,int20 int,decimal20
> decimal(15,8),double20 double,date20 date,string_out_20 string,string21
> string,int21 int,decimal21 decimal(15,8),double21 double,date21
> date,string_out_21 string,string22 string,int22 int,decimal22
> decimal(15,8),double22 double,date22 date,string_out_22 string,string23
> string,int23 int,decimal23 decimal,double23 double,date23 date,string_out_23
> string,string24 string,int24 int,decimal24 decimal(15,8),double24
> double,date24 date,string_out_24 string,string25 string,int25 int,decimal25
> decimal(15,8),double25 double,date25 date,string_out_25 string,string26
> string,int26 int,decimal26 decimal(15,8),double26 double,date26
> date,string_out_26 string,string27 string,int27 int,decimal27
> decimal(15,8),double27 double,date27 date,string_out_27 string,string28
> string,int28 int,decimal28 decimal(15,8),double28 double,date28
> date,string_out_28 string,string29 string,int29 int,decimal29
> decimal(15,8),double29 double,date29 date,string_out_29 string,string30
> string,int30 int,decimal30 decimal(15,8),double30 double,date30
> date,string_out_30 string,string31 string,int31 int,decimal31
> decimal(15,8),double31 double,date31 date,string_out_31 string,string32
> string,int32 int,decimal32 decimal(15,8),double32 double,date32
> date,string_out_32 string,string33 string,int33 int,decimal33
> decimal(15,8),double33 double,date33 date,string_out_33 string,string34
> string,int34 int,decimal34 decimal(15,8),double34 double,date34
> date,string_out_34 string,string35 string,int35 int,decimal35
> decimal(15,8),double35 double,date35 date,string_out_35 string,string36
> string,int36 int,decimal36 decimal(15,8),double36 double,date36
> date,string_out_36 string,string37 string,int37 int,decimal37
> decimal(15,8),double37 double,date37 date,string_out_37 string,string38
> string,int38 int,decimal38 decimal(15,8),double38 double,date38
> date,string_out_38 string,string39 string,int39 int,decimal39
> decimal(15,8),double39 double,date39 date,string_out_39 string,string40
> string,int40 int,decimal40 decimal(15,8),double40 double,date40
> date,string_out_40 string) ROW FORMAT DELIMITED FIELDS TERMINATED BY ','
> STORED AS TEXTFILE;
> 2) load data local in path '<file_path>' into table tgt_ManyCol_temp;
> 3) CREATE TABLE tgt_ManyCol (string1 string,int1 int,decimal1
> decimal(15,8),double1 double,date1 date,string_out_1 string,string2
> string,int2 int,decimal2 decimal(15,8),double2 double,date2 date,string_out_2
> string,string3 string,int3 int,decimal3 decimal(15,8),double3 double,date3
> date,string_out_3 string,string4 string,int4 int,decimal4
> decimal(15,8),double4 double,date4 date,string_out_4 string,string5
> string,int5 int,decimal5 decimal,double5 double,date5 date,string_out_5
> string,string6 string,int6 int,decimal6 decimal(15,8),double6 double,date6
> date,string_out_6 string,string7 string,int7 int,decimal7
> decimal(15,8),double7 double,date7 date,string_out_7 string,string8
> string,int8 int,decimal8 decimal(15,8),double8 double,date8 date,string_out_8
> string,string9 string,int9 int,decimal9 decimal(15,8),double9 double,date9
> date,string_out_9 string,string10 string,int10 int,decimal10
> decimal(15,8),double10 double,date10 date,string_out_10 string,string11
> string,int11 int,decimal11 decimal(15,8),double11 double,date11
> date,string_out_11 string,string12 string,int12 int,decimal12
> decimal(15,8),double12 double,date12 date,string_out_12 string,string13
> string,int13 int,decimal13 decimal(15,8),double13 double,date13
> date,string_out_13 string,string14 string,int14 int,decimal14
> decimal(15,8),double14 double,date14 date,string_out_14 string,string15
> string,int15 int,decimal15 decimal(15,8),double15 double,date15
> date,string_out_15 string,string16 string,int16 int,decimal16
> decimal(15,8),double16 double,date16 date,string_out_16 string,string17
> string,int17 int,decimal17 decimal(15,8),double17 double,date17
> date,string_out_17 string,string18 string,int18 int,decimal18
> decimal(15,8),double18 double,date18 date,string_out_18 string,string19
> string,int19 int,decimal19 decimal(15,8),double19 double,date19
> date,string_out_19 string,string20 string,int20 int,decimal20
> decimal(15,8),double20 double,date20 date,string_out_20 string,string21
> string,int21 int,decimal21 decimal(15,8),double21 double,date21
> date,string_out_21 string,string22 string,int22 int,decimal22
> decimal(15,8),double22 double,date22 date,string_out_22 string,string23
> string,int23 int,decimal23 decimal,double23 double,date23 date,string_out_23
> string,string24 string,int24 int,decimal24 decimal(15,8),double24
> double,date24 date,string_out_24 string,string25 string,int25 int,decimal25
> decimal(15,8),double25 double,date25 date,string_out_25 string,string26
> string,int26 int,decimal26 decimal(15,8),double26 double,date26
> date,string_out_26 string,string27 string,int27 int,decimal27
> decimal(15,8),double27 double,date27 date,string_out_27 string,string28
> string,int28 int,decimal28 decimal(15,8),double28 double,date28
> date,string_out_28 string,string29 string,int29 int,decimal29
> decimal(15,8),double29 double,date29 date,string_out_29 string,string30
> string,int30 int,decimal30 decimal(15,8),double30 double,date30
> date,string_out_30 string,string31 string,int31 int,decimal31
> decimal(15,8),double31 double,date31 date,string_out_31 string,string32
> string,int32 int,decimal32 decimal(15,8),double32 double,date32
> date,string_out_32 string,string33 string,int33 int,decimal33
> decimal(15,8),double33 double,date33 date,string_out_33 string,string34
> string,int34 int,decimal34 decimal(15,8),double34 double,date34
> date,string_out_34 string,string35 string,int35 int,decimal35
> decimal(15,8),double35 double,date35 date,string_out_35 string,string36
> string,int36 int,decimal36 decimal(15,8),double36 double,date36
> date,string_out_36 string,string37 string,int37 int,decimal37
> decimal(15,8),double37 double,date37 date,string_out_37 string,string38
> string,int38 int,decimal38 decimal(15,8),double38 double,date38
> date,string_out_38 string,string39 string,int39 int,decimal39
> decimal(15,8),double39 double,date39 date,string_out_39 string,string40
> string,int40 int,decimal40 decimal(15,8)) partitioned by (double40
> double,date40 date,string_out_40 string) ROW FORMAT DELIMITED FIELDS
> TERMINATED BY ',' STORED AS TEXTFILE;
> 4) insert overwrite table tgt_ManyCol partition (double40, date40,
> string_out_40) select * from tgt_ManyCol_temp;
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
