Hi Gupta,
Thanks for your reply, I check the claaspath by
Hadoop classpath | tr “:” “\n”
I find the classpath has $HADOOP_PREFIX/etc/hadoop
And other directories are directories under
$HADOOP_PREFIX/share/
I have checked that hdfs-site.xml valid .
And I also check the filecache directory .
Find some hdfs-site.xml in yarn stage filecache directory, and
I check with xmllint, it is valid.
Point me if I do something wrong,thanks.
Best Regards,
Evan
From: Gaurav Gupta [mailto:gaurav.gopi...@gmail.com]
Sent: 2016年1月21日 2:37
To: yaoxiaohua
Cc: common-u...@hadoop.apache.org
Subject: Re: container error for bad configuration
Container will take the hdfs-site.xml from the classpath. Can you check if your
classpath is correct?
On Tue, Jan 19, 2016 at 5:28 PM, yaoxiaohua <yaoxiao...@outlook.com> wrote:
Hi Gupta,
Thanks for your reply,
I observe the app running ,and find some containers failed, then
I enter the container directory and find the syserr file.
Cat and find that it report hdfs-site.xml is bad with
</description> sign.
Then I check all the data node hdfs-sitel.xml file with xmllint
, it looks fine all.
My confuse is that why yarn container running with
hdfs-site.xml ?
And I know that it doesn’t point the file
$HADOOP_HOME/etc/hadoop/hdfs-site.xml
It points to the local hdfs-site.xml, I don’t know why generate
a local hdfs-site.xml
In yarn stage folder. And I check all datanodes in yarn log
stage directory,
Find some hdfs-site.xml, and check it is ok.
From: Gaurav Gupta [mailto:gaurav.gopi...@gmail.com]
Sent: 2016年1月20日 8:09
To: yaoxiaohua
Cc: user@hadoop.apache.org
Subject: Re: container error for bad configuration
Hi Evan,
The error message clear suggests that resource file is bad. It is missing
</description> tag. Can you check other resource files too?
Thanks
Gaurav
On Tue, Jan 19, 2016 at 5:36 AM, yaoxiaohua <yaoxiao...@outlook.com> wrote:
Hi guys,
When I run applications on yarn, there is always some
containers failed for the following reason:
Tue, 19 Jan 2016 07:29:22 GMT Tue, 19 Jan 2016 07:29:30 GMT 7sec
Error: java.lang.RuntimeException: org.xml.sax.SAXParseException:
“description”must use“</description>”end。
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2338)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:851) at
org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:870) at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1889)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2379)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:339)
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:270)
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:432)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:164)
at org.apache.hadoop.mapred.YarnChild.configureLocalDirs(YarnChild.java:232)
at org.apache.hadoop.mapred.YarnChild.configureTask(YarnChild.java:290)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: org.xml.sax.SAXParseException: elementtype“description” must
used“</description>” end。
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at
org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at javax.xml.parsers.DocumentBuilder.parse(Unknown Source)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2173)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2161)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2232)
... 18 more Container killed by the ApplicationMaster. Container killed on
request.
Exit code is 143 Container exited with a non-zero exit code 143
It seems that the xml file are bad, I check marped-site.xml and yarn-site.xml,
it is fine.
Could you give me any tips
Best Regards,
Evan
