Error in running hive query

2012-01-06 Thread Bhavesh Shah
Hello,

hive> FROM (
> FROM subset
> MAP subset.patient_mrn, subset.encounter_date
> USING 'q1.txt'
> AS mp1, mp2
> CLUSTER BY mp1) map_output
> INSERT OVERWRITE TABLE t3
> REDUCE map_output.mp1
> USING 'retrieve'
> AS reducef1;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks not specified. Estimated from input data size: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=
In order to set a constant number of reducers:
  set mapred.reduce.tasks=
Starting Job = job_201112281627_0100, Tracking URL =
http://localhost:50030/jobdetails.jsp?jobid=job_201112281627_0100
Kill Command = /home/hadoop/hadoop-0.20.2-cdh3u2//bin/hadoop job
-Dmapred.job.tracker=localhost:54311 -kill job_201112281627_0100
2011-12-31 04:34:52,208 Stage-1 map = 0%,  reduce = 0%
2011-12-31 04:35:52,939 Stage-1 map = 0%,  reduce = 0%
2011-12-31 04:36:34,097 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201112281627_0100 with errors
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
hive>

In 'q1.txt' I have written query in Hive which returns 2 columns
and
In 'retrieve' I have wriiten a java code which takes 2 input and display
the 1 column

Is there any mistake in query.


Pls suggest me some solution.


-- 
Regards,
Bhavesh Shah


Re: Error in running hive query

2012-01-06 Thread Aniket Mokashi
[moving to user@hive]

Can you send us the details from task logs?

Thanks,
Aniket

On Fri, Jan 6, 2012 at 2:53 AM, Bhavesh Shah wrote:

> Hello,
>
> hive> FROM (
>> FROM subset
>> MAP subset.patient_mrn, subset.encounter_date
>> USING 'q1.txt'
>> AS mp1, mp2
>> CLUSTER BY mp1) map_output
>> INSERT OVERWRITE TABLE t3
>> REDUCE map_output.mp1
>> USING 'retrieve'
>> AS reducef1;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks not specified. Estimated from input data size: 1
> In order to change the average load for a reducer (in bytes):
>  set hive.exec.reducers.bytes.per.reducer=
> In order to limit the maximum number of reducers:
>  set hive.exec.reducers.max=
> In order to set a constant number of reducers:
>  set mapred.reduce.tasks=
> Starting Job = job_201112281627_0100, Tracking URL =
> http://localhost:50030/jobdetails.jsp?jobid=job_201112281627_0100
> Kill Command = /home/hadoop/hadoop-0.20.2-cdh3u2//bin/hadoop job
> -Dmapred.job.tracker=localhost:54311 -kill job_201112281627_0100
> 2011-12-31 04:34:52,208 Stage-1 map = 0%,  reduce = 0%
> 2011-12-31 04:35:52,939 Stage-1 map = 0%,  reduce = 0%
> 2011-12-31 04:36:34,097 Stage-1 map = 100%,  reduce = 100%
> Ended Job = job_201112281627_0100 with errors
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.MapRedTask
> hive>
>
> In 'q1.txt' I have written query in Hive which returns 2 columns
> and
> In 'retrieve' I have wriiten a java code which takes 2 input and display
> the 1 column
>
> Is there any mistake in query.
>
>
> Pls suggest me some solution.
>
>
> --
> Regards,
> Bhavesh Shah
>



-- 
"...:::Aniket:::... Quetzalco@tl"


Re: Error in running hive query

2012-01-08 Thread Bhavesh Shah
Hello,
This are my logs, related to my execution of Hive query.

2011-12-31 04:34:17,604 WARN  mapred.JobClient
(JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
2011-12-31 04:36:35,357 ERROR exec.MapRedTask
(SessionState.java:printError(343)) - Ended Job = job_201112281627_0100
with errors
2011-12-31 04:36:38,112 ERROR ql.Driver (SessionState.java:printError(343))
- FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
2011-12-31 05:37:34,750 WARN  mapred.JobClient
(JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
2011-12-31 05:42:58,176 ERROR exec.MapRedTask
(SessionState.java:printError(343)) - Ended Job = job_201112281627_0101
with errors
2011-12-31 05:43:16,748 ERROR ql.Driver (SessionState.java:printError(343))
- FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
2011-12-31 06:40:31,764 WARN  mapred.JobClient
(JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
2011-12-31 06:55:22,527 WARN  mapred.JobClient
(JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
2011-12-31 07:00:08,695 ERROR exec.MapRedTask
(SessionState.java:printError(343)) - Ended Job = job_201112281627_0103
with errors
2011-12-31 07:00:12,374 ERROR ql.Driver (SessionState.java:printError(343))
- FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
2011-12-31 07:08:21,565 WARN  mapred.JobClient
(JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
2011-12-31 07:10:23,405 ERROR exec.MapRedTask
(SessionState.java:printError(343)) - Ended Job = job_201112281627_0104
with errors
2011-12-31 07:10:25,006 ERROR ql.Driver (SessionState.java:printError(343))
- FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
2011-12-31 07:17:48,490 WARN  mapred.JobClient
(JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.


Pls tell me what to do te remove this error.


-- 
Regards,
Bhavesh Shah



On Fri, Jan 6, 2012 at 10:44 PM, Aniket Mokashi  wrote:

> [moving to user@hive]
>
> Can you send us the details from task logs?
>
> Thanks,
> Aniket
>
> On Fri, Jan 6, 2012 at 2:53 AM, Bhavesh Shah  >wrote:
>
> > Hello,
> >
> > hive> FROM (
> >> FROM subset
> >> MAP subset.patient_mrn, subset.encounter_date
> >> USING 'q1.txt'
> >> AS mp1, mp2
> >> CLUSTER BY mp1) map_output
> >> INSERT OVERWRITE TABLE t3
> >> REDUCE map_output.mp1
> >> USING 'retrieve'
> >> AS reducef1;
> > Total MapReduce jobs = 1
> > Launching Job 1 out of 1
> > Number of reduce tasks not specified. Estimated from input data size: 1
> > In order to change the average load for a reducer (in bytes):
> >  set hive.exec.reducers.bytes.per.reducer=
> > In order to limit the maximum number of reducers:
> >  set hive.exec.reducers.max=
> > In order to set a constant number of reducers:
> >  set mapred.reduce.tasks=
> > Starting Job = job_201112281627_0100, Tracking URL =
> > http://localhost:50030/jobdetails.jsp?jobid=job_201112281627_0100
> > Kill Command = /home/hadoop/hadoop-0.20.2-cdh3u2//bin/hadoop job
> > -Dmapred.job.tracker=localhost:54311 -kill job_201112281627_0100
> > 2011-12-31 04:34:52,208 Stage-1 map = 0%,  reduce = 0%
> > 2011-12-31 04:35:52,939 Stage-1 map = 0%,  reduce = 0%
> > 2011-12-31 04:36:34,097 Stage-1 map = 100%,  reduce = 100%
> > Ended Job = job_201112281627_0100 with errors
> > FAILED: Execution Error, return code 2 from
> > org.apache.hadoop.hive.ql.exec.MapRedTask
> > hive>
> >
> > In 'q1.txt' I have written query in Hive which returns 2 columns
> > and
> > In 'retrieve' I have wriiten a java code which takes 2 input and display
> > the 1 column
> >
> > Is there any mistake in query.
> >
> >
> > Pls suggest me some solution.
> >
> >
> > --
> > Regards,
> > Bhavesh Shah
> >
>
>
>
> --
> "...:::Aniket:::... Quetzalco@tl"
>