The copyFromLocalFile method has a void return, but internally is calling
FileUtil methods that may return a boolean for success. False appears to be
returned if the source file cannot be deleted, or if the dest directory cannot
be created. The boolean result is ignored by copyFromLocalFile le
On Apr 9, 2012, at 3:50 PM, Ralph Castain wrote:
>
> On Apr 9, 2012, at 2:45 PM, Kihwal Lee wrote:
>
>> The path, "file:/Users/rhc/yarnrun/13", indicates that your copy operation's
>> destination was the local file system, instead of hdfs.
>
> Yeah, I realized that too after I sent the note.
On Apr 9, 2012, at 2:45 PM, Kihwal Lee wrote:
> The path, "file:/Users/rhc/yarnrun/13", indicates that your copy operation's
> destination was the local file system, instead of hdfs.
Yeah, I realized that too after I sent the note. Sure enough - the files are
there.
> What is the value of "f
The path, "file:/Users/rhc/yarnrun/13", indicates that your copy operation's
destination was the local file system, instead of hdfs. What is the value of
"fs.default.name" set to in core-site.xml?
Kihwal
On 4/9/12 3:26 PM, "Ralph Castain" wrote:
Finally managed to chase down the 0.23 API do
Solved the "realm" warning courtesy of stackoverflow:
export HADOOP_OPTS="-Djava.security.krb5.realm=OX.AC.UK
-Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk"
solves it. Didn't help resolve the problem, as expected.
On Apr 9, 2012, at 2:26 PM, Ralph Castain wrote:
> Finally managed to cha
Finally managed to chase down the 0.23 API docs and get the FileStatus
definition. No real joy here - I output the path and got:
code: LOG.info("destination path " + destStatus.getPath());
2012-04-09 14:22:48,359 INFO Hamster (Hamster.java:getApplication(265)) -
destination path
I'd be happy to do so - if I could only find the blasted definition of
FileStatus!! Can you point me to it?
On Apr 9, 2012, at 1:27 PM, Kihwal Lee wrote:
> It looks like the home directory does not exist but the copy went through.
> Can you try to LOG the key fields in destStatus including path
It looks like the home directory does not exist but the copy went through.
Can you try to LOG the key fields in destStatus including path? It might be
ending up in an unexpected place.
Kihwal
On 4/9/12 12:45 PM, "Ralph Castain" wrote:
Hi Bobby
On Apr 9, 2012, at 11:40 AM, Robert Evans wrote
Ralph,
Do you have a home directory on HDFS ?
The job files are moved under your HDFS home directory, in a .staging
subdir.
In any case, not flagging it as an error, seems to be a genuine yarn bug.
- milind
---
Milind Bhandarkar
Greenplum Labs, EMC
(Disclaimer: Opinions expressed in this email
Hi Bobby
On Apr 9, 2012, at 11:40 AM, Robert Evans wrote:
> What do you mean by relocated some supporting files to HDFS? How do you
> relocate them? What API do you use?
I use the LocalResource and FileSystem classes to do the relocation, per the
Hadoop example:
// set local resourc
What do you mean by relocated some supporting files to HDFS? How do you
relocate them? What API do you use?
--Bobby Evans
On 4/9/12 11:10 AM, "Ralph Castain" wrote:
Hi folks
I'm trying to develop an AM for the 0.23 branch and running into a problem that
I'm having difficulty debugging. My
Hi folks
I'm trying to develop an AM for the 0.23 branch and running into a problem that
I'm having difficulty debugging. My client relocates some supporting files to
HDFS, creates the application object for the AM, and submits it to the RM.
The file relocation request doesn't generate an error
12 matches
Mail list logo
