[jira] Commented: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

2010-11-22 Thread Kang Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934725#action_12934725 ] Kang Xiao commented on HADOOP-6683: --- Thanks Collins! > the first optimization: ZlibComp

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934721#action_12934721 ] Owen O'Malley commented on HADOOP-6685: --- {quote} Tom brought up a lot of good points

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934691#action_12934691 ] Scott Carey commented on HADOOP-6685: - Tom brought up a lot of good points. {quote}

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934674#action_12934674 ] Tom White commented on HADOOP-6685: --- > This isn't true. SequenceFile needs to be changed

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934666#action_12934666 ] Owen O'Malley commented on HADOOP-6685: --- {quote} SequenceFile does not support index

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934653#action_12934653 ] Doug Cutting commented on HADOOP-6685: -- Owen> [Avro data files] don't support indices

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934644#action_12934644 ] Owen O'Malley commented on HADOOP-6685: --- {quote} The first is that no change is need

[jira] Commented: (HADOOP-7040) DiskChecker:mkdirsWithExistsCheck swallows FileNotFoundException.

2010-11-22 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934637#action_12934637 ] Boris Shkolnik commented on HADOOP-7040: yes. > DiskChecker:mkdirsWithExistsCheck

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934636#action_12934636 ] Eli Collins commented on HADOOP-6685: - bq. unless the build file was set up to exclude

[jira] Commented: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

2010-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934634#action_12934634 ] Hudson commented on HADOOP-6683: Integrated in Hadoop-Common-trunk-Commit #442 (See [http

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934633#action_12934633 ] Nigel Daley commented on HADOOP-6685: - +1 to JSON. > Change the generic serialization

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934627#action_12934627 ] Steve Loughran commented on HADOOP-6685: I've been doing lots of JSON work recentl

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934624#action_12934624 ] Konstantin Boudnik commented on HADOOP-6685: bq. However, in the case of a PB

[jira] Updated: (HADOOP-7040) DiskChecker:mkdirsWithExistsCheck swallows FileNotFoundException.

2010-11-22 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HADOOP-7040: Affects Version/s: 0.20.1 0.20.2 0.21.0 Fix V

[jira] Updated: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

2010-11-22 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HADOOP-6683: Resolution: Fixed Status: Resolved (was: Patch Available) I've committed this to branch 2

[jira] Commented: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

2010-11-22 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934614#action_12934614 ] Eli Collins commented on HADOOP-6683: - Thanks also for running the performance tests.

[jira] Resolved: (HADOOP-7047) RPC client gets stuck

2010-11-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang resolved HADOOP-7047. --- Resolution: Invalid I just realized that this problem has already been fixed in the trunk. T

[jira] Updated: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

2010-11-22 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HADOOP-6683: Priority: Minor (was: Major) Fix Version/s: 0.23.0 0.22.0 Ass

[jira] Commented: (HADOOP-7023) Add listCorruptFileBlocks to FileSystem

2010-11-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934600#action_12934600 ] Hairong Kuang commented on HADOOP-7023: --- +1. The patch looks good to me. > Add list

[jira] Commented: (HADOOP-7023) Add listCorruptFileBlocks to FileSystem

2010-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934590#action_12934590 ] Hadoop QA commented on HADOOP-7023: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-7023) Add listCorruptFileBlocks to FileSystem

2010-11-22 Thread Patrick Kling (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Kling updated HADOOP-7023: -- Attachment: HADOOP-7023.5.patch Incorporated Hairong's feedback. Thank you! Changed default c

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934571#action_12934571 ] Doug Cutting commented on HADOOP-6685: -- Tom> I actually prefer strings in serializati

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934566#action_12934566 ] Tom White commented on HADOOP-6685: --- I have two serious issues with the current patch, w

[jira] Commented: (HADOOP-7023) Add listCorruptFileBlocks to FileSystem

2010-11-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934558#action_12934558 ] Hairong Kuang commented on HADOOP-7023: --- The default constructor of CorruptFileBlock

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934557#action_12934557 ] Doug Cutting commented on HADOOP-6685: -- > There are no current replacements for its f

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934534#action_12934534 ] Owen O'Malley commented on HADOOP-6685: --- {quote} We should refrain from adding any n

[jira] Commented: (HADOOP-7047) RPC client gets stuck

2010-11-22 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934529#action_12934529 ] Luke Lu commented on HADOOP-7047: - Since we support only jdk 6+, why don't we just use {{n

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

2010-11-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934523#action_12934523 ] Doug Cutting commented on HADOOP-6685: -- > I question the validity of Doug's veto. His