[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676910#comment-13676910
]
Hudson commented on HDFS-4053:
--
Integrated in Hadoop-Yarn-trunk #232 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/232/])
HDFS-4053. Move the jira description to release 2.1.0 section (Revision
1490085)
Result = SUCCESS
jing9 : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1490085
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 2.1.0-beta
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676988#comment-13676988
]
Hudson commented on HDFS-4053:
--
Integrated in Hadoop-Hdfs-trunk #1422 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1422/])
HDFS-4053. Move the jira description to release 2.1.0 section (Revision
1490085)
Result = FAILURE
jing9 : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1490085
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 2.1.0-beta
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677045#comment-13677045
]
Hudson commented on HDFS-4053:
--
Integrated in Hadoop-Mapreduce-trunk #1448 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1448/])
HDFS-4053. Move the jira description to release 2.1.0 section (Revision
1490085)
Result = SUCCESS
jing9 : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1490085
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 2.1.0-beta
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676515#comment-13676515
]
Hudson commented on HDFS-4053:
--
Integrated in Hadoop-trunk-Commit #3867 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/3867/])
HDFS-4053. Move the jira description to release 2.1.0 section (Revision
1490085)
Result = SUCCESS
jing9 : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1490085
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 2.1.0-beta
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498255#comment-13498255
]
Suresh Srinivas commented on HDFS-4053:
---
Please address this comment:
bq. please update the release note about the new behavior.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 3.0.0
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13479939#comment-13479939
]
Hudson commented on HDFS-4053:
--
Integrated in Hadoop-Yarn-trunk #8 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/8/])
HDFS-4053. Increase the default block size. Contributed by Eli Collins
(Revision 1399908)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1399908
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 3.0.0
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480002#comment-13480002
]
Hudson commented on HDFS-4053:
--
Integrated in Hadoop-Hdfs-trunk #1200 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1200/])
HDFS-4053. Increase the default block size. Contributed by Eli Collins
(Revision 1399908)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1399908
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 3.0.0
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13480035#comment-13480035
]
Hudson commented on HDFS-4053:
--
Integrated in Hadoop-Mapreduce-trunk #1230 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1230/])
HDFS-4053. Increase the default block size. Contributed by Eli Collins
(Revision 1399908)
Result = SUCCESS
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1399908
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 3.0.0
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13479463#comment-13479463
]
Hudson commented on HDFS-4053:
--
Integrated in Hadoop-trunk-Commit #2890 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/2890/])
HDFS-4053. Increase the default block size. Contributed by Eli Collins
(Revision 1399908)
Result = FAILURE
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1399908
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
*
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Fix For: 3.0.0
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477661#comment-13477661
]
Hadoop QA commented on HDFS-4053:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12549440/hdfs-4053.txt
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-hdfs-project/hadoop-hdfs.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/3352//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3352//console
This message is automatically generated.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477687#comment-13477687
]
Hadoop QA commented on HDFS-4053:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12549447/hdfs-4053.txt
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-hdfs-project/hadoop-hdfs:
org.apache.hadoop.hdfs.server.balancer.TestBalancer
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/3353//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3353//console
This message is automatically generated.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477935#comment-13477935
]
Daryn Sharp commented on HDFS-4053:
---
+1 Assuming test failure is unrelated. I'd suggest having the default as
128*1024*1024 (it used to 64*1024*1024) since it's easier to grok. What
would be even better is allow units such as M, G, etc. I'm sure we have a
conversion method lurking somewhere in hadoop. Just suggestions.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478335#comment-13478335
]
Hadoop QA commented on HDFS-4053:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12549550/hdfs-4053.txt
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-hdfs-project/hadoop-hdfs.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/3356//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3356//console
This message is automatically generated.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478407#comment-13478407
]
Harsh J commented on HDFS-4053:
---
bq. I'm sure we have a conversion method lurking somewhere in hadoop.
This is already available. You can set dfs.blocksize as 128m on trunk and it
will be read fine.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt, hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477615#comment-13477615
]
Uma Maheswara Rao G commented on HDFS-4053:
---
{quote}
public static final longDFS_BLOCK_SIZE_DEFAULT = 64*1024*1024;
{quote}
We may have to change this also to 128MB right? Any reason for not changing
here?
Other than this, lgtm
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477625#comment-13477625
]
Arun C Murthy commented on HDFS-4053:
-
You'd also have to bump up MR configs to be consistent: I've reopened
MAPREDUCE-97.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477629#comment-13477629
]
Uma Maheswara Rao G commented on HDFS-4053:
---
Thanks for the update, Eli.
+1, lgtm. MR configs can be looked at MR-97 JIRA as Arun reopened it.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477632#comment-13477632
]
Uma Maheswara Rao G commented on HDFS-4053:
---
Pending Jenkins results...
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
Attachments: hdfs-4053.txt, hdfs-4053.txt
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476353#comment-13476353
]
Harsh J commented on HDFS-4053:
---
+1 on the change personally, I've not seen more than a few instances of 64 MB
in use among configs I go through, among the several clusters I help out on.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4053) Increase the default block size
[
https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476421#comment-13476421
]
Suresh Srinivas commented on HDFS-4053:
---
+1 for making it 128MB.
Increase the default block size
---
Key: HDFS-4053
URL: https://issues.apache.org/jira/browse/HDFS-4053
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Eli Collins
Assignee: Eli Collins
The default HDFS block size ({{dfs.blocksize}}) has been 64mb forever. 128mb
works well in practice on today's hardware configurations, most clusters I
work with use it or higher (eg 256mb). Let's bump to 128mb in trunk for v3.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
