[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12924286#action_12924286
]
Hudson commented on HDFS-1435:
--
Integrated in Hadoop-Hdfs-trunk-Commit #415 (See
[https://huds
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12923213#action_12923213
]
dhruba borthakur commented on HDFS-1435:
+1, code looks good to me.
> Provide an o
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12922987#action_12922987
]
Aaron T. Myers commented on HDFS-1435:
--
Thanks for the clarification, Hairong.
Konstan
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12922702#action_12922702
]
Hairong Kuang commented on HDFS-1435:
-
Sorry for the confusion. The bug is introduced by
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12922695#action_12922695
]
Aaron T. Myers commented on HDFS-1435:
--
Hi Hairong, what bug in the OIV did this fix? a
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12921494#action_12921494
]
Hairong Kuang commented on HDFS-1435:
-
[exec] +1 overall.
[exec]
[exec
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12921193#action_12921193
]
dhruba borthakur commented on HDFS-1435:
I looked at the code, looks good. Have two
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12921178#action_12921178
]
Hairong Kuang commented on HDFS-1435:
-
Todd, this is a wonderful idea! When I discussed
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12921170#action_12921170
]
Todd Lipcon commented on HDFS-1435:
---
Hey Hairong. Another idea which you may want to exper
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12921068#action_12921068
]
Hairong Kuang commented on HDFS-1435:
-
Oops! The header of the table above should shift
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12921060#action_12921060
]
Hairong Kuang commented on HDFS-1435:
-
I did experiments with a secondary namenode using
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920929#action_12920929
]
Lu Yilei commented on HDFS-1435:
to Kuang, If the fsimage is very big. The network is full
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920770#action_12920770
]
Hairong Kuang commented on HDFS-1435:
-
@Lu, compressing the fsimage has additional advan
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920513#action_12920513
]
Doug Cutting commented on HDFS-1435:
Hairong, I don' think that using Avro is critical h
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920237#action_12920237
]
Lu Yilei commented on HDFS-1435:
We also encountered the same problem, our fsimage has 12G.
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920008#action_12920008
]
Hairong Kuang commented on HDFS-1435:
-
Sorry that I did not get to work on Avro's file f
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12919079#action_12919079
]
Doug Cutting commented on HDFS-1435:
Hairong, Avro's file format has little overhead. I
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12918800#action_12918800
]
Jeff Hammerbacher commented on HDFS-1435:
-
bq. Jeff, I'd like to take a look at the
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12918222#action_12918222
]
Hairong Kuang commented on HDFS-1435:
-
LZO compression codec is not supported in Hadoop
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917876#action_12917876
]
dhruba borthakur commented on HDFS-1435:
+1 on compressing the entire file.
The VER
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917768#action_12917768
]
Hairong Kuang commented on HDFS-1435:
-
I thought more about Philip's suggestion. So inst
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917164#action_12917164
]
dhruba borthakur commented on HDFS-1435:
> time to load the image and the time to d
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916938#action_12916938
]
Hairong Kuang commented on HDFS-1435:
-
Phillip, your suggestion definitely has value tha
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916795#action_12916795
]
Jeff Hammerbacher commented on HDFS-1435:
-
Could we use the Avro file format to stor
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916793#action_12916793
]
Philip Zeyliger commented on HDFS-1435:
---
Instead of changing the binary format, could
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916747#action_12916747
]
Hairong Kuang commented on HDFS-1435:
-
This depends on the compression algorithm to be u
[
https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12916737#action_12916737
]
Dmytro Molkov commented on HDFS-1435:
-
Do you expect the time to load the image and the
27 matches
Mail list logo