ot practical to have nodes with 1PB of data for the reasons
>> that others have mentioned and due to the replication traffic that will be
>> generated if the node dies. Not to mention fsck times with large file
>> systems.
>>
>>
>>
>> Vijay
>>
>>
>>
ve nodes with 1PB of data for the
> reasons
> > that others have mentioned and due to the replication traffic that will
> be
> > generated if the node dies. Not to mention fsck times with large file
> > systems.
> >
> >
> >
> > Vijay
> >
> >
for the reasons
> that others have mentioned and due to the replication traffic that will be
> generated if the node dies. Not to mention fsck times with large file
> systems.
>
>
>
> Vijay
>
>
>
>
>
>
>
> From: jeba earnest [mailto:jebaearn...@yahoo.c
ot;Pamecha, Abhishek"
To: "user@hadoop.apache.org" ; jeba earnest
Sent: Wednesday, 30 January 2013 2:45 PM
Subject: Re: Maximum Storage size in a Single datanode
What would be the reason you would do that?
You would want to leverage distributed dataset for higher availab
de.
> Is there any limitations in hadoop for storage in single node?
>
>
>
> Regards,
> Jeba
>
> From: "Pamecha, Abhishek"
> To: "user@hadoop.apache.org" ; jeba earnest <
jebaearn...@yahoo.com>
> Sent: We
hadoop for storage in single node?
>
>
>
> Regards,
> Jeba
> --
> *From:* "Pamecha, Abhishek"
> *To:* "user@hadoop.apache.org" ; jeba earnest <
> jebaearn...@yahoo.com>
> *Sent:* Wednesday, 30 January 2013 2:45 PM
To: "user@hadoop.apache.org" ; jeba earnest
Sent: Wednesday, 30 January 2013 2:45 PM
Subject: Re: Maximum Storage size in a Single datanode
What would be the reason you would do that?
You would want to leverage distributed dataset for higher availability and
better response times.
The max
What would be the reason you would do that?
You would want to leverage distributed dataset for higher availability and
better response times.
The maximum storage depends completely on the disks capacity of your nodes and
what your OS supports. Typically I have heard of about 1-2 TB/node to sta
January 2013 09:14
To: user@hadoop.apache.org; jeba earnest
Subject: Re: Maximum Storage size in a Single datanode
I would say the hard limit is due to the OS local file system (and your
budget).
So short answer for ext3 : it doesn't seems so.
http://en.wikipedia.org/wiki/Ext3
And I am not
I would say the hard limit is due to the OS local file system (and your
budget).
So short answer for ext3 : it doesn't seems so.
http://en.wikipedia.org/wiki/Ext3
And I am not sure the answer is the most interesting. Even if you could put
1 Peta on one node, what is usually interesting is the rat
10 matches
Mail list logo
