[
https://issues.apache.org/jira/browse/HIVE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13762823#comment-13762823
]
jeff little commented on HIVE-5245:
-----------------------------------
hive (test)> create table test_09 as
> select a.* from test_01 a
> left outer join test_02 b
> on (a.id=b.id);
Automatically selecting local only mode for query
Total MapReduce jobs = 1
setting HADOOP_USER_NAME hadoop
13/09/10 15:44:32 WARN conf.Configuration:
file:/tmp/hadoop/hive_2013-09-10_15-44-30_620_3609535307275149310/-local-10005/jobconf.xml:a
attempt to override final parameter: mapred.system.dir; Ignoring.
13/09/10 15:44:32 WARN conf.Configuration:
file:/tmp/hadoop/hive_2013-09-10_15-44-30_620_3609535307275149310/-local-10005/jobconf.xml:a
attempt to override final parameter: mapred.local.dir; Ignoring.
Execution log at: /tmp/hadoop/.log
2013-09-10 03:44:32 Starting to launch local task to process map join;
maximum memory = 932118528
2013-09-10 03:44:33 Processing rows: 4 Hashtable size: 4
Memory usage: 110986304 rate: 0.119
2013-09-10 03:44:33 Dump the hashtable into file:
file:/tmp/hadoop/hive_2013-09-10_15-44-30_620_3609535307275149310/-local-10002/HashTable-Stage-4/MapJoin-mapfile01--.hashtable
2013-09-10 03:44:33 Upload 1 File to:
file:/tmp/hadoop/hive_2013-09-10_15-44-30_620_3609535307275149310/-local-10002/HashTable-Stage-4/MapJoin-mapfile01--.hashtable
File size: 444
2013-09-10 03:44:33 End of local task; Time Taken: 0.562 sec.
Execution completed successfully
Mapred Local Task Succeeded . Convert the Join into MapJoin
Mapred Local Task Succeeded . Convert the Join into MapJoin
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
13/09/10 15:44:35 WARN conf.Configuration:
file:/tmp/hadoop/hive_2013-09-10_15-44-30_620_3609535307275149310/-local-10006/jobconf.xml:a
attempt to override final parameter: mapred.system.dir; Ignoring.
13/09/10 15:44:35 WARN conf.Configuration:
file:/tmp/hadoop/hive_2013-09-10_15-44-30_620_3609535307275149310/-local-10006/jobconf.xml:a
attempt to override final parameter: mapred.local.dir; Ignoring.
Execution log at: /tmp/hadoop/.log
Job running in-process (local Hadoop)
Hadoop job information for null: number of mappers: 0; number of reducers: 0
2013-09-10 15:44:38,793 null map = 0%, reduce = 0%
2013-09-10 15:44:41,800 null map = 100%, reduce = 0%
Ended Job = job_local_0001
Execution completed successfully
Mapred Local Task Succeeded . Convert the Join into MapJoin
Moving data to: hdfs://namenode:9000/user/hive/warehouse/test.db/test_09
Table test.test_09 stats: [num_partitions: 0, num_files: 2, num_rows: 26,
total_size: 491, raw_data_size: 465]
OK
Time taken: 14.86 seconds
hive (test)> select * from test_09;
OK
11 jeff f 20130812
11 jeff f 20130812
11 jeff f 20130812
11 jeff f 20130812
12 smith f 20130812
12 smith f 20130812
12 smith f 20130812
12 smith f 20130812
13 alex f 20130812
13 alex f 20130812
13 alex f 20130812
13 alex f 20130812
14 tom f 20130812
14 tom f 20130812
14 tom f 20130812
14 tom f 20130812
11 jeff f 20130813
11 jeff f 20130813
11 jeff f 20130813
11 jeff f 20130813
17 smith f 20130813
18 alex f 20130813
14 tom f 20130813
14 tom f 20130813
14 tom f 20130813
14 tom f 20130813
Time taken: 0.071 seconds, Fetched: 26 row(s)
Problem:
why? the left outer join operator for CTAS, otherwise join not!
> hive create table as select(CTAS) can not work(not support) with join on
> operator
> ---------------------------------------------------------------------------------
>
> Key: HIVE-5245
> URL: https://issues.apache.org/jira/browse/HIVE-5245
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 0.11.0
> Reporter: jeff little
> Labels: CTAS, hive
> Fix For: 0.11.0
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> hello everyone, recently i came across one hive problem as below:
> hive (test)> create table test_09 as
> > select a.* from test_01 a
> > join test_02 b
> > on (a.id=b.id);
> Automatically selecting local only mode for query
> Total MapReduce jobs = 2
> setting HADOOP_USER_NAME hadoop
> 13/09/09 17:22:36 WARN conf.Configuration:
> file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a
> attempt to override final parameter: mapred.system.dir; Ignoring.
> 13/09/09 17:22:36 WARN conf.Configuration:
> file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a
> attempt to override final parameter: mapred.local.dir; Ignoring.
> Execution log at: /tmp/hadoop/.log
> 2013-09-09 05:22:36 Starting to launch local task to process map join;
> maximum memory = 932118528
> 2013-09-09 05:22:37 Processing rows: 4 Hashtable size: 4
> Memory usage: 113068056 rate: 0.121
> 2013-09-09 05:22:37 Dump the hashtable into file:
> file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
> 2013-09-09 05:22:37 Upload 1 File to:
> file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
> File size: 788
> 2013-09-09 05:22:37 End of local task; Time Taken: 0.444 sec.
> Execution completed successfully
> Mapred Local Task Succeeded . Convert the Join into MapJoin
> Mapred Local Task Succeeded . Convert the Join into MapJoin
> Launching Job 1 out of 2
> Number of reduce tasks is set to 0 since there's no reduce operator
> 13/09/09 17:22:38 WARN conf.Configuration:
> file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a
> attempt to override final parameter: mapred.system.dir; Ignoring.
> 13/09/09 17:22:38 WARN conf.Configuration:
> file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a
> attempt to override final parameter: mapred.local.dir; Ignoring.
> Execution log at: /tmp/hadoop/.log
> Job running in-process (local Hadoop)
> Hadoop job information for null: number of mappers: 0; number of reducers: 0
> 2013-09-09 17:22:41,807 null map = 0%, reduce = 0%
> 2013-09-09 17:22:44,814 null map = 100%, reduce = 0%
> Ended Job = job_local_0001
> Execution completed successfully
> Mapred Local Task Succeeded . Convert the Join into MapJoin
> Stage-7 is filtered out by condition resolver.
> OK
> Time taken: 13.138 seconds
> hive (test)> select * from test_08;
> FAILED: SemanticException [Error 10001]: Line 1:14 Table not found 'test_08'
> hive (test)>
> Problem:
> I can't get the created table, namely this CTAS is nonavailable, and this
> table is not created by this hql sentence at all.who can explain for
> me.Thanks.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
