if you have a single node cluster, then just configure everything to localhost. But if you have two nodes then thats a problem cause in any cluster nodes need to talk with each other without authentication on network level
On Tue, Jul 24, 2012 at 4:19 PM, <[email protected]> wrote: > Thanks Nitin :-), Thank you very much. > > Yes my n/w setup with proxy authentication, if I do remove proxy foe HTTP, > HTTPS then it works but the Internet goes down. > > I set the proxy bypass for machine and it worked. :-) > > Thanks a Lot > Yogesh Kumar > ________________________________________ > From: Nitin Pawar [[email protected]] > Sent: Tuesday, July 24, 2012 2:13 PM > To: [email protected] > Subject: Re: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.MapRedTask MapReduce Jobs Launched: > > yogesh, > is your network setup with proxy authentication? normally the error > which you are getting is, when a node tries to connect to another node > but then after some time, the connection needs to be reauthorized. > > when you do a select * from table, it does not launch a MR, it just > does a dfs -cat of the hdfs file > > you will need to check the cluster health of your hadoop cluster. Also > make sure that on all the nodes the default linux security is off > (iptables ) > > On Tue, Jul 24, 2012 at 2:09 PM, <[email protected]> wrote: >> Thanks Mohammad :-), >> >> I didn't get regarding which proxy settings Please explain it, >> >> If i do operations like. >> select * from dummysite, >> or >> select * from dummysite where id=10; >> >> such command shows proper result and doesn't through any error. >> >> Please suggest. >> >> Regards >> Yogesh Kumar >> ________________________________________ >> From: Mohammad Tariq [[email protected]] >> Sent: Tuesday, July 24, 2012 2:00 PM >> To: [email protected] >> Subject: Re: Execution Error, return code 2 from >> org.apache.hadoop.hive.ql.exec.MapRedTask MapReduce Jobs Launched: >> >> Hello Yogesh, >> >> Are any proxy settings involved??Error code 407 indicates that >> the client must first authenticate itself with the proxy in order to >> proceed further. Just make sure everything is in place. >> >> Regards, >> Mohammad Tariq >> >> >> On Tue, Jul 24, 2012 at 1:55 PM, <[email protected]> wrote: >>> Hi All, >>> >>> even If if perform count(*) operation on table it shows error, >>> >>> select count(*) from dummysite; >>> >>> >>> Total MapReduce jobs = 1 >>> Launching Job 1 out of 1 >>> Number of reduce tasks determined at compile time: 1 >>> In order to change the average load for a reducer (in bytes): >>> set hive.exec.reducers.bytes.per.reducer=<number> >>> In order to limit the maximum number of reducers: >>> set hive.exec.reducers.max=<number> >>> In order to set a constant number of reducers: >>> set mapred.reduce.tasks=<number> >>> Starting Job = job_201207231123_0011, Tracking URL = >>> http://localhost:50030/jobdetails.jsp?jobid=job_201207231123_0011 >>> Kill Command = /HADOOP/hadoop-0.20.2/bin/../bin/hadoop job >>> -Dmapred.job.tracker=localhost:9001 -kill job_201207231123_0011 >>> Hadoop job information for Stage-1: number of mappers: 1; number of >>> reducers: 1 >>> 2012-07-24 13:38:18,928 Stage-1 map = 0%, reduce = 0% >>> 2012-07-24 13:38:21,938 Stage-1 map = 100%, reduce = 0% >>> 2012-07-24 13:39:22,170 Stage-1 map = 100%, reduce = 0% >>> 2012-07-24 13:39:25,181 Stage-1 map = 100%, reduce = 100% >>> Ended Job = job_201207231123_0011 with errors >>> Error during job, obtaining debugging information... >>> Examining task ID: task_201207231123_0011_m_000002 (and more) from job >>> job_201207231123_0011 >>> Exception in thread "Thread-93" java.lang.RuntimeException: Error while >>> reading from task log url >>> at >>> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130) >>> at >>> org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211) >>> at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81) >>> at java.lang.Thread.run(Thread.java:680) >>> Caused by: java.io.IOException: Server returned HTTP response code: 407 for >>> URL: >>> http://10.203.33.81:50060/tasklog?taskid=attempt_201207231123_0011_r_000000_0&start=-8193 >>> at >>> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436) >>> at java.net.URL.openStream(URL.java:1010) >>> at >>> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120) >>> ... 3 more >>> FAILED: Execution Error, return code 2 from >>> org.apache.hadoop.hive.ql.exec.MapRedTask >>> MapReduce Jobs Launched: >>> Job 0: Map: 1 Reduce: 1 HDFS Read: 24 HDFS Write: 0 FAIL >>> Total MapReduce CPU Time Spent: 0 msec >>> >>> >>> Please suggest why this error is comming :-( >>> >>> Regards >>> Yogesh Kumar >>> >>> Please do not print this email unless it is absolutely necessary. >>> >>> The information contained in this electronic message and any attachments to >>> this message are intended for the exclusive use of the addressee(s) and may >>> contain proprietary, confidential or privileged information. If you are not >>> the intended recipient, you should not disseminate, distribute or copy this >>> e-mail. Please notify the sender immediately and destroy all copies of this >>> message and any attachments. >>> >>> WARNING: Computer viruses can be transmitted via email. The recipient should >>> check this email and any attachments for the presence of viruses. The >>> company accepts no liability for any damage caused by any virus transmitted >>> by this email. >>> >>> www.wipro.com >> >> Please do not print this email unless it is absolutely necessary. >> >> The information contained in this electronic message and any attachments to >> this message are intended for the exclusive use of the addressee(s) and may >> contain proprietary, confidential or privileged information. If you are not >> the intended recipient, you should not disseminate, distribute or copy this >> e-mail. Please notify the sender immediately and destroy all copies of this >> message and any attachments. >> >> WARNING: Computer viruses can be transmitted via email. The recipient should >> check this email and any attachments for the presence of viruses. The >> company accepts no liability for any damage caused by any virus transmitted >> by this email. >> >> www.wipro.com > > > > -- > Nitin Pawar > > Please do not print this email unless it is absolutely necessary. > > The information contained in this electronic message and any attachments to > this message are intended for the exclusive use of the addressee(s) and may > contain proprietary, confidential or privileged information. If you are not > the intended recipient, you should not disseminate, distribute or copy this > e-mail. Please notify the sender immediately and destroy all copies of this > message and any attachments. > > WARNING: Computer viruses can be transmitted via email. The recipient should > check this email and any attachments for the presence of viruses. The company > accepts no liability for any damage caused by any virus transmitted by this > email. > > www.wipro.com -- Nitin Pawar
