Re: low memory in hadoop

2020-02-16 Thread political science
Ok thanks for your suggestion. I increased the ram to a little bit that
helped.
I get following
debian@osboxes:~$ docker run -it hadoop-build-1001
 _   _   ___
| | | | | |   |  _  \
| |_| | __ _  __| | ___   ___  _ __   | | | |_   __
|  _  |/ _` |/ _` |/ _ \ / _ \| '_ \  | | | / _ \ \ / /
| | | | (_| | (_| | (_) | (_) | |_) | | |/ /  __/\ V /
\_| |_/\__,_|\__,_|\___/ \___/| .__/  |___/ \___| \_(_)
  | |
  |_|
This is the standard Hadoop Developer build environment.
This has all the right tools installed required to build
Hadoop from source.

Apparently you are inside this docker container as the user root.
Putting it simply:
   This should not occur.
Known possible causes of this are:
1) Running this script as the root user ( Just don't )
2) Running an old docker version ( upgrade to 1.4.1 or higher )

  ___  __   _
 / _ \| |  | | (_)
/ /_\ \ |__   ___  _ __| |_ _ _ __   __ _
|  _  | '_ \ / _ \| '__| __| | '_ \ / _` |
| | | | |_) | (_) | |  | |_| | | | | (_| |
\_| |_/_.__/ \___/|_|   \__|_|_| |_|\__, |
 __/ |
|___/
/home/debian/hadoop_env_checks.sh: line 78: logout: not login shell: use
`exit'


how should I proceed from here to have login accounts created etc ?


On Sun, 16 Feb 2020 at 22:13, Jeff Hubbs  wrote:

> You probably need more memory.
>
> Understand that in order to do anything remotely useful Hadoop needs a lot
> of memory. Just to run the terasort benchmark, my cluster's worker nodes
> needed 8GiB RAM.
>
> On 2/16/20 9:41 AM, political science wrote:
>
> I had installed hadoop and I am facing low memory error on Hadoop
> installation.
> Since installation. I am not clear with what to do to fix this.
> I have been searching on various forums from past 2-3 months about this.
>
> I had installed hadoop on a Ubuntu virtual machine as per instructions
> available in README file in sources folder every thing went fine there were
> some errors at the end  I am getting a low memory message.
> Here is a screenshot for the same.
> https://i.stack.imgur.com/GZOr9.jpg
>
> the output of
> sudo du -h / | grep [a-z]*G > filesizes.txt
> https://pastebin.com/kKr3FtiG
> What should I do?
>
>
>


Re: low memory in hadoop

2020-02-16 Thread Jeff Hubbs

You probably need more memory.

Understand that in order to do anything remotely useful Hadoop needs a 
lot of memory. Just to run the terasort benchmark, my cluster's worker 
nodes needed 8GiB RAM.


On 2/16/20 9:41 AM, political science wrote:
I had installed hadoop and I am facing low memory error on Hadoop 
installation.

Since installation. I am not clear with what to do to fix this.
I have been searching on various forums from past 2-3 months about this.

I had installed hadoop on a Ubuntu virtual machine as per instructions 
available in README file in sources folder every thing went fine there 
were some errors at the end I am getting a low memory message.

Here is a screenshot for the same.
https://i.stack.imgur.com/GZOr9.jpg

the output of
sudo du -h / | grep [a-z]*G > filesizes.txt
https://pastebin.com/kKr3FtiG
What should I do?





low memory in hadoop

2020-02-16 Thread political science
I had installed hadoop and I am facing low memory error on Hadoop
installation.
Since installation. I am not clear with what to do to fix this.
I have been searching on various forums from past 2-3 months about this.

I had installed hadoop on a Ubuntu virtual machine as per instructions
available in README file in sources folder every thing went fine there were
some errors at the end  I am getting a low memory message.
Here is a screenshot for the same.
<https://i.stack.imgur.com/GZOr9.jpg>
https://i.stack.imgur.com/GZOr9.jpg

the output of
sudo du -h / | grep [a-z]*G > filesizes.txt
https://pastebin.com/kKr3FtiG
What should I do?