[
https://issues.apache.org/jira/browse/PIG-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13029082#comment-13029082
]
Bill Graham commented on PIG-2034:
----------------------------------
Yup. I just tried the same with WordCount and got the same failure, so this
doesn't seem to be a Pig bug. Do you think this is a valid MapReduce bug?
{code}
Exception in thread "main" java.net.UnknownHostException: unknown host:
colo1-hadoop-nn-r0-n0
at org.apache.hadoop.ipc.Client$Connection.<init>(Client.java:195)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:850)
at org.apache.hadoop.ipc.Client.call(Client.java:720)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
at $Proxy0.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
at
org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1419)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1444)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1432)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
at org.apache.hadoop.mapred.JobClient.getFs(JobClient.java:504)
at
org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:608)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:802)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:771)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1290)
at cnwk.hadoop.mapreduce.WordCount.main(WordCount.java:54)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
{code}
> Pig client uses fs.default.name as provided from the JobTracker instead of
> local value
> --------------------------------------------------------------------------------------
>
> Key: PIG-2034
> URL: https://issues.apache.org/jira/browse/PIG-2034
> Project: Pig
> Issue Type: Bug
> Reporter: Bill Graham
> Attachments: pig_1304465896181.log
>
>
> When submitting a Pig job, the client uses the {{fs.default.name}} supplied
> to it by the JobTracker (via core-site.xml on the master typically) during
> the staging phase. After that, the client then uses the {{fs.default.name}}
> from it's local configs. This seems like a bug to me. Expected behavior would
> be to always use the local value.
> I found this bug when the server configs were set to not use a FQDN for
> {{fs.default.name}}. This caused the client to fail because it didn't have
> the same default DNS domain.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
