The hadoop script in 0.20.x probably has all of the features that the
hdfs script in 0.21.x has (plus the functionality of the mapred
script). Give this a try and see if you get any errors.
-Joey
On Thu, May 19, 2011 at 8:31 AM, Gabriele Kahlout
<gabri...@mysimpatico.com> wrote:
> that simple? No changes to hdfs-config.sh?
>
> What about all the other stuff in the hdfs?
> For example the script calls hdfs dfs , like that won't it crash?
>
> elif [ "$COMMAND" = "dfs" ] ; then
> CLASS=org.apache.hadoop.fs.FsShell
>
> On Thu, May 19, 2011 at 5:26 PM, Joey Echeverria <j...@cloudera.com> wrote:
>
>> I would just write your own hdfs script that has the following:
>>
>> #!/bin/sh
>>
>> export HADOOP_HOME=/path/to/hadoop
>> exec ${HADOOP_HOME}/bin/hadoop "$@"
>>
>> -Joey
>>
>> On Thu, May 19, 2011 at 8:10 AM, Gabriele Kahlout
>> <gabri...@mysimpatico.com> wrote:
>> > because I've an immutable script written for hadoop that uses hdfs.
>> >
>> > On Thu, May 19, 2011 at 5:02 PM, Joey Echeverria <j...@cloudera.com>
>> wrote:
>> >
>> >> Why do you need the hdfs script? Typically 0.20.x is used with just the
>> >> hadoop script.
>> >>
>> >> -Joey
>> >> On May 19, 2011 8:00 AM, "Gabriele Kahlout" <gabri...@mysimpatico.com>
>> >> wrote:
>> >> > $ hadoop version
>> >> > Hadoop 0.20.3-SNAPSHOT
>> >> > Subversion
>> >> >
>> >>
>> http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-append-r
>> >> > 1041718
>> >> > Compiled by hammer on Mon Dec 6 17:38:16 CET 2010
>> >> >
>> >> >
>> >> > On Thu, May 19, 2011 at 4:55 PM, Joey Echeverria <j...@cloudera.com>
>> >> wrote:
>> >> >
>> >> >> What version of hadoop is installed?
>> >> >>
>> >> >> -Joey
>> >> >> On May 19, 2011 7:49 AM, "Gabriele Kahlout" <
>> gabri...@mysimpatico.com>
>> >> >> wrote:
>> >> >> > I said i don't have write access (~ the administrator with write
>> >> access
>> >> >> will
>> >> >> > not place the script for me).
>> >> >> >
>> >> >> > On Thu, May 19, 2011 at 3:56 PM, Niels Basjes <ni...@basjes.nl>
>> >> wrote:
>> >> >> >
>> >> >> >> So why don't you ask for someone with write access to put the file
>> >> >> there?
>> >> >> >>
>> >> >> >> 2011/5/19 Gabriele Kahlout <gabri...@mysimpatico.com>:
>> >> >> >> > so your question is, why do you have the problem in the first
>> >> place?
>> >> >> >> > because it's not in $HADOOP_HOME/bin (older hadoop) and I don't
>> >> have
>> >> >> >> wrtie
>> >> >> >> > access.
>> >> >> >> >
>> >> >> >> > On Thu, May 19, 2011 at 3:33 PM, Joey Echeverria <
>> >> j...@cloudera.com>
>> >> >> >> wrote:
>> >> >> >> >
>> >> >> >> >> Why do you need to move the script from $HADOOP_HOME/bin?
>> >> >> >> >>
>> >> >> >> >> Can't you just symlink it or write a script which runs the
>> >> original?
>> >> >> >> >>
>> >> >> >> >> -Joey
>> >> >> >> >>
>> >> >> >> >> On May 19, 2011, at 4:15, Gabriele Kahlout <
>> >> gabri...@mysimpatico.com
>> >> >> >
>> >> >> >> >> wrote:
>> >> >> >> >>
>> >> >> >> >> > I'm still having the following problem, any suggestions?
>> >> >> >> >> >
>> >> >> >> >> > I'm trying to modify the
>> >> >> >> >> > hdfs<
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >> >>
>> >>
>> >>
>> http://svn.apache.org/viewvc/hadoop/hdfs/tags/release-0.21.0/bin/hdfs?view=markup
>> >> >> >> >> >script
>> >> >> >> >> > so that it still functions although not located in
>> >> $HADOOP_HOME/bin
>> >> >> >> >> > anymore, but when I execute the modified hdfs I get:
>> >> >> >> >> >
>> >> >> >> >> > hdfs: line 110: exec: org.apache.hadoop.fs.FsShell: not found
>> >> >> >> >> >
>> >> >> >> >> > line 110 is:
>> >> >> >> >> >
>> >> >> >> >> > exec "$JAVA" $JAVA_HEAP_MAX $HADOOP_OPTS $CLASS "$@"
>> >> >> >> >> >
>> >> >> >> >> > I've highlighted the changes I made to the script:
>> >> >> >> >> >
>> >> >> >> >> > bin=*"$HADOOP_HOME"/bin # was* dirname "$0" bin=cd "$bin";
>> pwd
>> >> >> >> >> >
>> >> >> >> >> > ./*hdfs-config.sh # was .* "$bin"/hdfs-config.sh
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >> > On Mon, May 16, 2011 at 12:20 PM, Gabriele Kahlout <
>> >> >> >> >> gabri...@mysimpatico.com
>> >> >> >> >> >> wrote:
>> >> >> >> >> >
>> >> >> >> >> >> http://stackoverflow.com/q/6015818/300248
>> >> >> >> >> >>
>> >> >> >> >> >> --
>> >> >> >> >> >> Regards,
>> >> >> >> >> >> K. Gabriele
>> >> >> >> >> >>
>> >> >> >> >> >> --- unchanged since 20/9/10 ---
>> >> >> >> >> >> P.S. If the subject contains "[LON]" or the addressee
>> >> acknowledges
>> >> >> >> the
>> >> >> >> >> >> receipt within 48 hours then I don't resend the email.
>> >> >> >> >> >> subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x,
>> >> this)
>> >> >> ∧
>> >> >> >> >> >> time(x) < Now + 48h) ⇒ ¬resend(I, this).
>> >> >> >> >> >>
>> >> >> >> >> >> If an email is sent by a sender that is not a trusted
>> contact
>> >> or
>> >> >> the
>> >> >> >> >> email
>> >> >> >> >> >> does not contain a valid code then the email is not
>> received. A
>> >> >> valid
>> >> >> >> >> code
>> >> >> >> >> >> starts with a hyphen and ends with "X".
>> >> >> >> >> >> ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈
>> >> subject(x)
>> >> >> ∧
>> >> >> >> y ∈
>> >> >> >> >> >> L(-[a-z]+[0-9]X)).
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >> > --
>> >> >> >> >> > Regards,
>> >> >> >> >> > K. Gabriele
>> >> >> >> >> >
>> >> >> >> >> > --- unchanged since 20/9/10 ---
>> >> >> >> >> > P.S. If the subject contains "[LON]" or the addressee
>> >> acknowledges
>> >> >> the
>> >> >> >> >> > receipt within 48 hours then I don't resend the email.
>> >> >> >> >> > subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x,
>> >> this)
>> >> >> ∧
>> >> >> >> >> time(x)
>> >> >> >> >> > < Now + 48h) ⇒ ¬resend(I, this).
>> >> >> >> >> >
>> >> >> >> >> > If an email is sent by a sender that is not a trusted contact
>> or
>> >> >> the
>> >> >> >> >> email
>> >> >> >> >> > does not contain a valid code then the email is not received.
>> A
>> >> >> valid
>> >> >> >> >> code
>> >> >> >> >> > starts with a hyphen and ends with "X".
>> >> >> >> >> > ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈
>> >> subject(x)
>> >> >> ∧
>> >> >> y
>> >> >> >> ∈
>> >> >> >> >> > L(-[a-z]+[0-9]X)).
>> >> >> >> >>
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >
>> >> >> >> > --
>> >> >> >> > Regards,
>> >> >> >> > K. Gabriele
>> >> >> >> >
>> >> >> >> > --- unchanged since 20/9/10 ---
>> >> >> >> > P.S. If the subject contains "[LON]" or the addressee
>> acknowledges
>> >> the
>> >> >> >> > receipt within 48 hours then I don't resend the email.
>> >> >> >> > subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x,
>> this)
>> >> ∧
>> >> >> >> time(x)
>> >> >> >> > < Now + 48h) ⇒ ¬resend(I, this).
>> >> >> >> >
>> >> >> >> > If an email is sent by a sender that is not a trusted contact or
>> >> the
>> >> >> >> email
>> >> >> >> > does not contain a valid code then the email is not received. A
>> >> valid
>> >> >> >> code
>> >> >> >> > starts with a hyphen and ends with "X".
>> >> >> >> > ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈
>> subject(x)
>> >> ∧
>> >> y
>> >> >> ∈
>> >> >> >> > L(-[a-z]+[0-9]X)).
>> >> >> >> >
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >> --
>> >> >> >> Met vriendelijke groeten,
>> >> >> >>
>> >> >> >> Niels Basjes
>> >> >> >>
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> > --
>> >> >> > Regards,
>> >> >> > K. Gabriele
>> >> >> >
>> >> >> > --- unchanged since 20/9/10 ---
>> >> >> > P.S. If the subject contains "[LON]" or the addressee acknowledges
>> the
>> >> >> > receipt within 48 hours then I don't resend the email.
>> >> >> > subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this)
>> ∧
>> >> >> time(x)
>> >> >> > < Now + 48h) ⇒ ¬resend(I, this).
>> >> >> >
>> >> >> > If an email is sent by a sender that is not a trusted contact or
>> the
>> >> >> email
>> >> >> > does not contain a valid code then the email is not received. A
>> valid
>> >> >> code
>> >> >> > starts with a hyphen and ends with "X".
>> >> >> > ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x)
>> ∧ y
>> >> ∈
>> >> >> > L(-[a-z]+[0-9]X)).
>> >> >>
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Regards,
>> >> > K. Gabriele
>> >> >
>> >> > --- unchanged since 20/9/10 ---
>> >> > P.S. If the subject contains "[LON]" or the addressee acknowledges the
>> >> > receipt within 48 hours then I don't resend the email.
>> >> > subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧
>> >> time(x)
>> >> > < Now + 48h) ⇒ ¬resend(I, this).
>> >> >
>> >> > If an email is sent by a sender that is not a trusted contact or the
>> >> email
>> >> > does not contain a valid code then the email is not received. A valid
>> >> code
>> >> > starts with a hyphen and ends with "X".
>> >> > ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y
>> ∈
>> >> > L(-[a-z]+[0-9]X)).
>> >>
>> >
>> >
>> >
>> > --
>> > Regards,
>> > K. Gabriele
>> >
>> > --- unchanged since 20/9/10 ---
>> > P.S. If the subject contains "[LON]" or the addressee acknowledges the
>> > receipt within 48 hours then I don't resend the email.
>> > subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧
>> time(x)
>> > < Now + 48h) ⇒ ¬resend(I, this).
>> >
>> > If an email is sent by a sender that is not a trusted contact or the
>> email
>> > does not contain a valid code then the email is not received. A valid
>> code
>> > starts with a hyphen and ends with "X".
>> > ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈
>> > L(-[a-z]+[0-9]X)).
>> >
>>
>>
>>
>> --
>> Joseph Echeverria
>> Cloudera, Inc.
>> 443.305.9434
>>
>
>
>
> --
> Regards,
> K. Gabriele
>
> --- unchanged since 20/9/10 ---
> P.S. If the subject contains "[LON]" or the addressee acknowledges the
> receipt within 48 hours then I don't resend the email.
> subject(this) ∈ L(LON*) ∨ ∃x. (x ∈ MyInbox ∧ Acknowledges(x, this) ∧ time(x)
> < Now + 48h) ⇒ ¬resend(I, this).
>
> If an email is sent by a sender that is not a trusted contact or the email
> does not contain a valid code then the email is not received. A valid code
> starts with a hyphen and ends with "X".
> ∀x. x ∈ MyInbox ⇒ from(x) ∈ MySafeSenderList ∨ (∃y. y ∈ subject(x) ∧ y ∈
> L(-[a-z]+[0-9]X)).
>
--
Joseph Echeverria
Cloudera, Inc.
443.305.9434
