hadoop 2.2 build

[Karim Awara]

Hi,

I was setting up hadoop 2.2 following
theseinstructions
on a single machine with a tiny modification in an environment
variable naming to make it fully work. However, I face the problem that
when I run jps (after starting dfs and yarn), I don't find a datanode
process at all. How can I check what is wrong?

--
6623 NodeManager
6418 ResourceManager
7131 Jps
6246 SecondaryNameNode
5791 NameNode
---


--
Best Regards,
Karim Ahmed Awara

-- 

--
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

Re: hadoop 2.2 build

[Azuryy Yu]

Can you check the datanode log to find what error happended?


On Sat, Dec 14, 2013 at 9:27 AM, Karim Awara wrote:

> Hi,
>
> I was setting up hadoop 2.2 following 
> theseinstructions
>  on a single machine with a tiny modification in an environment
> variable naming to make it fully work. However, I face the problem that
> when I run jps (after starting dfs and yarn), I don't find a datanode
> process at all. How can I check what is wrong?
>
> --
> 6623 NodeManager
> 6418 ResourceManager
> 7131 Jps
> 6246 SecondaryNameNode
> 5791 NameNode
> ---
>
>
> --
> Best Regards,
> Karim Ahmed Awara
>
> --
> This message and its contents, including attachments are intended solely
> for the original recipient. If you are not the intended recipient or have
> received this message in error, please notify me immediately and delete
> this message from your computer system. Any unauthorized use or
> distribution is prohibited. Please consider the environment before printing
> this email.

Re: hadoop 2.2 build

[Karim Awara]

Is it in /var/log/hadoop/?  Cause I dont have a hadoop folder there.

--
Best Regards,
Karim Ahmed Awara


On Sat, Dec 14, 2013 at 4:40 AM, Azuryy Yu  wrote:

> Can you check the datanode log to find what error happended?
>
>
> On Sat, Dec 14, 2013 at 9:27 AM, Karim Awara wrote:
>
>> Hi,
>>
>> I was setting up hadoop 2.2 following 
>> theseinstructions
>>  on a single machine with a tiny modification in an environment
>> variable naming to make it fully work. However, I face the problem that
>> when I run jps (after starting dfs and yarn), I don't find a datanode
>> process at all. How can I check what is wrong?
>>
>> --
>> 6623 NodeManager
>> 6418 ResourceManager
>> 7131 Jps
>> 6246 SecondaryNameNode
>> 5791 NameNode
>> ---
>>
>>
>> --
>> Best Regards,
>> Karim Ahmed Awara
>>
>> --
>> This message and its contents, including attachments are intended solely
>> for the original recipient. If you are not the intended recipient or have
>> received this message in error, please notify me immediately and delete
>> this message from your computer system. Any unauthorized use or
>> distribution is prohibited. Please consider the environment before printing
>> this email.
>
>
>

-- 

--
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

Re: hadoop 2.2 build

[Karim Awara]

Hi,

I found them.. It says this error in the datanode log:

"java.io.IOException: Failed on local exception: java.io.EOFException; Host
Details : local host is: "DELL1/127.0.1.1"; destination host is:
"localhost":9000; "


--
Best Regards,
Karim Ahmed Awara


On Sat, Dec 14, 2013 at 6:07 AM, Karim Awara wrote:

>
> Is it in /var/log/hadoop/?  Cause I dont have a hadoop folder there.
>
> --
> Best Regards,
> Karim Ahmed Awara
>
>
> On Sat, Dec 14, 2013 at 4:40 AM, Azuryy Yu  wrote:
>
>> Can you check the datanode log to find what error happended?
>>
>>
>> On Sat, Dec 14, 2013 at 9:27 AM, Karim Awara wrote:
>>
>>> Hi,
>>>
>>> I was setting up hadoop 2.2 following 
>>> theseinstructions
>>>  on a single machine with a tiny modification in an environment
>>> variable naming to make it fully work. However, I face the problem that
>>> when I run jps (after starting dfs and yarn), I don't find a datanode
>>> process at all. How can I check what is wrong?
>>>
>>> --
>>> 6623 NodeManager
>>> 6418 ResourceManager
>>> 7131 Jps
>>> 6246 SecondaryNameNode
>>> 5791 NameNode
>>> ---
>>>
>>>
>>> --
>>> Best Regards,
>>> Karim Ahmed Awara
>>>
>>> --
>>> This message and its contents, including attachments are intended solely
>>> for the original recipient. If you are not the intended recipient or have
>>> received this message in error, please notify me immediately and delete
>>> this message from your computer system. Any unauthorized use or
>>> distribution is prohibited. Please consider the environment before printing
>>> this email.
>>
>>
>>
>

-- 

--
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

Re: hadoop 2.2 build

[Karim Awara]

And these are in my  /etc/hosts  file:

"
127.0.0.1   localhost
127.0.1.1   DELL1
"

Please let me know what to do.

--
Best Regards,
Karim Ahmed Awara


On Sat, Dec 14, 2013 at 6:18 AM, Karim Awara wrote:

> Hi,
>
> I found them.. It says this error in the datanode log:
>
> "java.io.IOException: Failed on local exception: java.io.EOFException;
> Host Details : local host is: "DELL1/127.0.1.1"; destination host is:
> "localhost":9000; "
>
>
> --
> Best Regards,
> Karim Ahmed Awara
>
>
> On Sat, Dec 14, 2013 at 6:07 AM, Karim Awara wrote:
>
>>
>> Is it in /var/log/hadoop/?  Cause I dont have a hadoop folder there.
>>
>> --
>> Best Regards,
>> Karim Ahmed Awara
>>
>>
>> On Sat, Dec 14, 2013 at 4:40 AM, Azuryy Yu  wrote:
>>
>>> Can you check the datanode log to find what error happended?
>>>
>>>
>>> On Sat, Dec 14, 2013 at 9:27 AM, Karim Awara 
>>> wrote:
>>>
 Hi,

 I was setting up hadoop 2.2 following 
 theseinstructions
  on a single machine with a tiny modification in an environment
 variable naming to make it fully work. However, I face the problem that
 when I run jps (after starting dfs and yarn), I don't find a datanode
 process at all. How can I check what is wrong?

 --
 6623 NodeManager
 6418 ResourceManager
 7131 Jps
 6246 SecondaryNameNode
 5791 NameNode
 ---


 --
 Best Regards,
 Karim Ahmed Awara

 --
 This message and its contents, including attachments are intended
 solely for the original recipient. If you are not the intended recipient or
 have received this message in error, please notify me immediately and
 delete this message from your computer system. Any unauthorized use or
 distribution is prohibited. Please consider the environment before printing
 this email.
>>>
>>>
>>>
>>
>

-- 

--
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

Re: hadoop 2.2 build

[Chris Mawata]

Try using tge actual ip of your machine where you have the 127.0.1.1
Chris
On Dec 13, 2013 10:20 PM, "Karim Awara"  wrote:

> Hi,
>
> I found them.. It says this error in the datanode log:
>
> "java.io.IOException: Failed on local exception: java.io.EOFException;
> Host Details : local host is: "DELL1/127.0.1.1"; destination host is:
> "localhost":9000; "
>
>
> --
> Best Regards,
> Karim Ahmed Awara
>
>
> On Sat, Dec 14, 2013 at 6:07 AM, Karim Awara wrote:
>
>>
>> Is it in /var/log/hadoop/?  Cause I dont have a hadoop folder there.
>>
>> --
>> Best Regards,
>> Karim Ahmed Awara
>>
>>
>> On Sat, Dec 14, 2013 at 4:40 AM, Azuryy Yu  wrote:
>>
>>> Can you check the datanode log to find what error happended?
>>>
>>>
>>> On Sat, Dec 14, 2013 at 9:27 AM, Karim Awara 
>>> wrote:
>>>
 Hi,

 I was setting up hadoop 2.2 following 
 theseinstructions
  on a single machine with a tiny modification in an environment
 variable naming to make it fully work. However, I face the problem that
 when I run jps (after starting dfs and yarn), I don't find a datanode
 process at all. How can I check what is wrong?

 --
 6623 NodeManager
 6418 ResourceManager
 7131 Jps
 6246 SecondaryNameNode
 5791 NameNode
 ---


 --
 Best Regards,
 Karim Ahmed Awara

 --
 This message and its contents, including attachments are intended
 solely for the original recipient. If you are not the intended recipient or
 have received this message in error, please notify me immediately and
 delete this message from your computer system. Any unauthorized use or
 distribution is prohibited. Please consider the environment before printing
 this email.
>>>
>>>
>>>
>>
>
> --
> This message and its contents, including attachments are intended solely
> for the original recipient. If you are not the intended recipient or have
> received this message in error, please notify me immediately and delete
> this message from your computer system. Any unauthorized use or
> distribution is prohibited. Please consider the environment before printing
> this email.

Re: hadoop 2.2 build

[Karim Awara]

Still same error exactly as if I didn't change anything.

--
Best Regards,
Karim Ahmed Awara


On Sat, Dec 14, 2013 at 6:48 AM, Chris Mawata wrote:

> Try using tge actual ip of your machine where you have the 127.0.1.1
> Chris
> On Dec 13, 2013 10:20 PM, "Karim Awara"  wrote:
>
>> Hi,
>>
>> I found them.. It says this error in the datanode log:
>>
>> "java.io.IOException: Failed on local exception: java.io.EOFException;
>> Host Details : local host is: "DELL1/127.0.1.1"; destination host is:
>> "localhost":9000; "
>>
>>
>> --
>> Best Regards,
>> Karim Ahmed Awara
>>
>>
>> On Sat, Dec 14, 2013 at 6:07 AM, Karim Awara wrote:
>>
>>>
>>> Is it in /var/log/hadoop/?  Cause I dont have a hadoop folder there.
>>>
>>> --
>>> Best Regards,
>>> Karim Ahmed Awara
>>>
>>>
>>> On Sat, Dec 14, 2013 at 4:40 AM, Azuryy Yu  wrote:
>>>
 Can you check the datanode log to find what error happended?


 On Sat, Dec 14, 2013 at 9:27 AM, Karim Awara 
 wrote:

> Hi,
>
> I was setting up hadoop 2.2 following 
> theseinstructions
>  on a single machine with a tiny modification in an environment
> variable naming to make it fully work. However, I face the problem that
> when I run jps (after starting dfs and yarn), I don't find a datanode
> process at all. How can I check what is wrong?
>
> --
> 6623 NodeManager
> 6418 ResourceManager
> 7131 Jps
> 6246 SecondaryNameNode
> 5791 NameNode
> ---
>
>
> --
> Best Regards,
> Karim Ahmed Awara
>
> --
> This message and its contents, including attachments are intended
> solely for the original recipient. If you are not the intended recipient 
> or
> have received this message in error, please notify me immediately and
> delete this message from your computer system. Any unauthorized use or
> distribution is prohibited. Please consider the environment before 
> printing
> this email.



>>>
>>
>> --
>> This message and its contents, including attachments are intended solely
>> for the original recipient. If you are not the intended recipient or have
>> received this message in error, please notify me immediately and delete
>> this message from your computer system. Any unauthorized use or
>> distribution is prohibited. Please consider the environment before printing
>> this email.
>
>

-- 

--
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

hadoop-2.2: build error on FreeBSD

[Dmitry Sivachenko]

Hello!

FreeBSD does not need "-ldl" when linking programs that use dlopen() (dlopen is 
in libc).
Now I am getting the following error trying to compile hadoop-2.2.0 on FreeBSD:

 [exec] /usr/bin/cc  -fPIC  -g -Wall -O2 -D_REENTRANT -D_GNU_SOURCE 
-D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64   -shared 
-Wl,-soname,libhdfs.so.0.0.0 -o target/usr/local/lib/libhdfs.so.0.0.0 
CMakeFiles/hdfs.dir/main/native/libhdfs/exception.c.o 
CMakeFiles/hdfs.dir/main/native/libhdfs/jni_helper.c.o 
CMakeFiles/hdfs.dir/main/native/libhdfs/hdfs.c.o 
/usr/local/openjdk7/jre/lib/amd64/server/libjvm.so -ldl -lpthread 
-Wl,-rpath,/usr/local/openjdk7/jre/lib/amd64/server
[exec] /usr/local/bin/cmake 
-H/usr/home/mitya/hadoop-2.2.0-src/hadoop-hdfs-project/hadoop-hdfs/src 
-B/usr/home/mitya/hadoop-2.2.0-src/h/usr/bin/ld: cannot find -ldl


Can you please adjust your build system not to use "-ldl" on FreeBSD?

Thanks!