[
https://issues.apache.org/jira/browse/HIVE-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joydeep Sen Sarma updated HIVE-1562:
------------------------------------
Summary: CombineHiveInputFormat issues in minimr mode (was: sample10.q
fails in minimr mode)
Description:
followup from HIVE-1523. This is probably because of CombineHiveInputFormat:
ant -Dclustermode=miniMR -Dtestcase=TestCliDriver -Dqfile=sample10.q test
insert overwrite table srcpartbucket partition(ds, hr) select * from srcpart
where ds is not null and key < 10
2010-08-18 15:13:54,378 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: query: insert overwrite table srcpartbucket partition(ds, hr) select
*\
from srcpart where ds is not null and key < 10
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: type: QUERY
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: Input: defa...@srcpart@ds=2008-04-08/hr=11
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: Input: defa...@srcpart@ds=2008-04-08/hr=12
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: Input: defa...@srcpart@ds=2008-04-09/hr=11
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: Input: defa...@srcpart@ds=2008-04-09/hr=12
2010-08-18 15:13:54,704 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
for parsing the arguments. Applicati\
ons should implement Tool for the same.
2010-08-18 15:13:55,642 ERROR mapred.EagerTaskInitializationListener
(EagerTaskInitializationListener.java:run(83)) - Job initialization failed:
java.lang.IllegalArgumentException: Network location name contains /:
/default-rack
at org.apache.hadoop.net.NodeBase.set(NodeBase.java:75)
at org.apache.hadoop.net.NodeBase.<init>(NodeBase.java:57)
at
org.apache.hadoop.mapred.JobTracker.addHostToNodeMapping(JobTracker.java:2326)
at
org.apache.hadoop.mapred.JobTracker.resolveAndAddToTopology(JobTracker.java:2320)
at org.apache.hadoop.mapred.JobInProgress.createCache(JobInProgress.java:343)
at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:440)
at
org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
2010-08-18 15:13:56,566 ERROR exec.MapRedTask
(SessionState.java:printError(277)) - Ended Job = job_201008181513_0001 with
errors
2010-08-18 15:13:56,597 ERROR ql.Driver (SessionState.java:printError(277)) -
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedT\
ask
See also:combine2.q
was:
followup from HIVE-1523. This is probably because of CombineHiveInputFormat:
ant -Dclustermode=miniMR -Dtestcase=TestCliDriver -Dqfile=smb_mapjoin_8.q test
insert overwrite table srcpartbucket partition(ds, hr) select * from srcpart
where ds is not null and key < 10
2010-08-18 15:13:54,378 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: query: insert overwrite table srcpartbucket partition(ds, hr) select
*\
from srcpart where ds is not null and key < 10
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: type: QUERY
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: Input: defa...@srcpart@ds=2008-04-08/hr=11
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: Input: defa...@srcpart@ds=2008-04-08/hr=12
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: Input: defa...@srcpart@ds=2008-04-09/hr=11
2010-08-18 15:13:54,379 ERROR SessionState (SessionState.java:printError(277))
- PREHOOK: Input: defa...@srcpart@ds=2008-04-09/hr=12
2010-08-18 15:13:54,704 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
for parsing the arguments. Applicati\
ons should implement Tool for the same.
2010-08-18 15:13:55,642 ERROR mapred.EagerTaskInitializationListener
(EagerTaskInitializationListener.java:run(83)) - Job initialization failed:
java.lang.IllegalArgumentException: Network location name contains /:
/default-rack
at org.apache.hadoop.net.NodeBase.set(NodeBase.java:75)
at org.apache.hadoop.net.NodeBase.<init>(NodeBase.java:57)
at
org.apache.hadoop.mapred.JobTracker.addHostToNodeMapping(JobTracker.java:2326)
at
org.apache.hadoop.mapred.JobTracker.resolveAndAddToTopology(JobTracker.java:2320)
at org.apache.hadoop.mapred.JobInProgress.createCache(JobInProgress.java:343)
at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:440)
at
org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
2010-08-18 15:13:56,566 ERROR exec.MapRedTask
(SessionState.java:printError(277)) - Ended Job = job_201008181513_0001 with
errors
2010-08-18 15:13:56,597 ERROR ql.Driver (SessionState.java:printError(277)) -
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedT\
ask
> CombineHiveInputFormat issues in minimr mode
> --------------------------------------------
>
> Key: HIVE-1562
> URL: https://issues.apache.org/jira/browse/HIVE-1562
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Joydeep Sen Sarma
>
> followup from HIVE-1523. This is probably because of CombineHiveInputFormat:
> ant -Dclustermode=miniMR -Dtestcase=TestCliDriver -Dqfile=sample10.q test
> insert overwrite table srcpartbucket partition(ds, hr) select * from srcpart
> where ds is not null and key < 10
> 2010-08-18 15:13:54,378 ERROR SessionState
> (SessionState.java:printError(277)) - PREHOOK: query: insert overwrite table
> srcpartbucket partition(ds, hr) select *\
> from srcpart where ds is not null and key < 10
> 2010-08-18 15:13:54,379 ERROR SessionState
> (SessionState.java:printError(277)) - PREHOOK: type: QUERY
> 2010-08-18 15:13:54,379 ERROR SessionState
> (SessionState.java:printError(277)) - PREHOOK: Input:
> defa...@srcpart@ds=2008-04-08/hr=11
> 2010-08-18 15:13:54,379 ERROR SessionState
> (SessionState.java:printError(277)) - PREHOOK: Input:
> defa...@srcpart@ds=2008-04-08/hr=12
> 2010-08-18 15:13:54,379 ERROR SessionState
> (SessionState.java:printError(277)) - PREHOOK: Input:
> defa...@srcpart@ds=2008-04-09/hr=11
> 2010-08-18 15:13:54,379 ERROR SessionState
> (SessionState.java:printError(277)) - PREHOOK: Input:
> defa...@srcpart@ds=2008-04-09/hr=12
> 2010-08-18 15:13:54,704 WARN mapred.JobClient
> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
> for parsing the arguments. Applicati\
> ons should implement Tool for the same.
> 2010-08-18 15:13:55,642 ERROR mapred.EagerTaskInitializationListener
> (EagerTaskInitializationListener.java:run(83)) - Job initialization failed:
> java.lang.IllegalArgumentException: Network location name contains /:
> /default-rack
> at org.apache.hadoop.net.NodeBase.set(NodeBase.java:75)
> at org.apache.hadoop.net.NodeBase.<init>(NodeBase.java:57)
> at
> org.apache.hadoop.mapred.JobTracker.addHostToNodeMapping(JobTracker.java:2326)
> at
> org.apache.hadoop.mapred.JobTracker.resolveAndAddToTopology(JobTracker.java:2320)
> at
> org.apache.hadoop.mapred.JobInProgress.createCache(JobInProgress.java:343)
> at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:440)
> at
> org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> at java.lang.Thread.run(Thread.java:619)
> 2010-08-18 15:13:56,566 ERROR exec.MapRedTask
> (SessionState.java:printError(277)) - Ended Job = job_201008181513_0001 with
> errors
> 2010-08-18 15:13:56,597 ERROR ql.Driver (SessionState.java:printError(277)) -
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.MapRedT\
> ask
> See also:combine2.q
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.