[jira] [Commented] (HADOOP-7761) Improve performance of raw comparisons

[ https://issues.apache.org/jira/browse/HADOOP-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420818#comment-13420818 ] Scott Carey commented on HADOOP-7761: - {quote} this is much slower {quote} It appears

[jira] [Commented] (HADOOP-7761) Improve performance of raw comparisons

[ https://issues.apache.org/jira/browse/HADOOP-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419560#comment-13419560 ] Scott Carey commented on HADOOP-7761: - Any benchmarks showing that this helps hadoop?

[jira] [Commented] (HADOOP-7156) getpwuid_r is not thread-safe on RHEL6

[ https://issues.apache.org/jira/browse/HADOOP-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103819#comment-13103819 ] Scott Carey commented on HADOOP-7156: - {quote}Red Hat has released a fix for this as

[jira] [Commented] (HADOOP-7589) Prefer mvn test -DskipTests over mvn compile in test-patch.sh

[ https://issues.apache.org/jira/browse/HADOOP-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13093030#comment-13093030 ] Scott Carey commented on HADOOP-7589: - Doesn't using 'mvn test-compile' the same as '

[jira] [Commented] (HADOOP-7537) Add PowerMock for the development of better tests

[ https://issues.apache.org/jira/browse/HADOOP-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13088912#comment-13088912 ] Scott Carey commented on HADOOP-7537: - I have had mostly bad experiences with PowerMo

[jira] [Commented] (HADOOP-7264) Bump avro version to at least 1.4.1

[ https://issues.apache.org/jira/browse/HADOOP-7264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13087426#comment-13087426 ] Scott Carey commented on HADOOP-7264: - Maven convention is to have each type of sourc

[jira] [Commented] (HADOOP-7264) Bump avro version to at least 1.4.1

[ https://issues.apache.org/jira/browse/HADOOP-7264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13085996#comment-13085996 ] Scott Carey commented on HADOOP-7264: - Avro-1.5.x also allows you to pick and choose

[jira] [Commented] (HADOOP-7506) hadoopcommon build version cant be set from the maven commandline

[ https://issues.apache.org/jira/browse/HADOOP-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13079144#comment-13079144 ] Scott Carey commented on HADOOP-7506: - I have given up on the maven-release-plugin.

[jira] [Commented] (HADOOP-7206) Integrate Snappy compression

[ https://issues.apache.org/jira/browse/HADOOP-7206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053622#comment-13053622 ] Scott Carey commented on HADOOP-7206: - Would it be reasonable to split snappy-java up

[jira] [Commented] (HADOOP-7206) Integrate Snappy compression

[ https://issues.apache.org/jira/browse/HADOOP-7206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053598#comment-13053598 ] Scott Carey commented on HADOOP-7206: - bq. Regarding to your 'unknown' last time I'v

[jira] [Commented] (HADOOP-7206) Integrate Snappy compression

[ https://issues.apache.org/jira/browse/HADOOP-7206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053595#comment-13053595 ] Scott Carey commented on HADOOP-7206: - bq. IMO this is a big NO NO. I rather have som

[jira] [Commented] (HADOOP-7206) Integrate Snappy compression

[ https://issues.apache.org/jira/browse/HADOOP-7206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053590#comment-13053590 ] Scott Carey commented on HADOOP-7206: - bq. However, it has a serious drawback; the na

[jira] [Commented] (HADOOP-7333) Performance improvement in PureJavaCrc32

[ https://issues.apache.org/jira/browse/HADOOP-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040327#comment-13040327 ] Scott Carey commented on HADOOP-7333: - In particular, hotspot had some changes in how

[jira] Commented: (HADOOP-7069) Replace forrest with supported framework

[ https://issues.apache.org/jira/browse/HADOOP-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977643#action_12977643 ] Scott Carey commented on HADOOP-7069: - bq. The mavenization effort is a huge amount of

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12971812#action_12971812 ] Scott Carey commented on HADOOP-6685: - I apologize for replying to something from the

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934979#action_12934979 ] Scott Carey commented on HADOOP-6685: - bq. That is interesting. I had never seen shade

[jira] Commented: (HADOOP-6685) Change the generic serialization framework API to use serialization-specific bytes instead of Map for configuration

[ https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934691#action_12934691 ] Scott Carey commented on HADOOP-6685: - Tom brought up a lot of good points. {quote}

[jira] Commented: (HADOOP-6945) Inclusion of Old Jackson-JSON Breaks tasks using Avro (or any task depending on Jackson JSON)

[ https://issues.apache.org/jira/browse/HADOOP-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12907292#action_12907292 ] Scott Carey commented on HADOOP-6945: - +1. And this is a big enough annoyance to back

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903759#action_12903759 ] Scott Carey commented on HADOOP-6884: - bq. I've got a feeling that Scott is very stro

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903150#action_12903150 ] Scott Carey commented on HADOOP-6884: - What has been shown is that over 80% of the per

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902930#action_12902930 ] Scott Carey commented on HADOOP-6884: - This is not much different than just using SLF4

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899484#action_12899484 ] Scott Carey commented on HADOOP-6884: - bq. Thanks Luke for clarfying aspectj. If aspe

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899441#action_12899441 ] Scott Carey commented on HADOOP-6884: - bq. Of course, the other tactic is to say "no l

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899228#action_12899228 ] Scott Carey commented on HADOOP-6884: - bq. Also #3 seems to be fairly simple with a si

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899110#action_12899110 ] Scott Carey commented on HADOOP-6884: - It must also be ensured that isDebugEnabled() i

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899084#action_12899084 ] Scott Carey commented on HADOOP-6884: - At most two of these can be true: 1. Code must

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898461#action_12898461 ] Scott Carey commented on HADOOP-6884: - bq. Scott: build time - means we wouldn't be ab

[jira] Commented: (HADOOP-6884) Add LOG.isDebugEnabled() guard for each LOG.debug("...")

[ https://issues.apache.org/jira/browse/HADOOP-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898287#action_12898287 ] Scott Carey commented on HADOOP-6884: - One could use something like ASM to re-write lo

[jira] Commented: (HADOOP-6868) Text class should provide method to return byte array of getLength()

[ https://issues.apache.org/jira/browse/HADOOP-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12890374#action_12890374 ] Scott Carey commented on HADOOP-6868: - I don't think that is a bug. Passing around b

[jira] Commented: (HADOOP-6837) Support for LZMA compression

[ https://issues.apache.org/jira/browse/HADOOP-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12883630#action_12883630 ] Scott Carey commented on HADOOP-6837: - What happens if you compress a tarball of those

[jira] Commented: (HADOOP-6837) Support for LZMA compression

[ https://issues.apache.org/jira/browse/HADOOP-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882214#action_12882214 ] Scott Carey commented on HADOOP-6837: - Isn't there a new variant of LZMA (file extensi

[jira] Commented: (HADOOP-6782) TestAvroRpc fails with avro-1.3.1 and avro-1.3.2

[ https://issues.apache.org/jira/browse/HADOOP-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869785#action_12869785 ] Scott Carey commented on HADOOP-6782: - I think I have seen something similar with Avro

[jira] Commented: (HADOOP-6166) Improve PureJavaCrc32

[ https://issues.apache.org/jira/browse/HADOOP-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12745095#action_12745095 ] Scott Carey commented on HADOOP-6166: - Great test results! The conclusions I draw fro

[jira] Commented: (HADOOP-6166) Improve PureJavaCrc32

[ https://issues.apache.org/jira/browse/HADOOP-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12741993#action_12741993 ] Scott Carey commented on HADOOP-6166: - We probably want to have Todd's concurrency tes

[jira] Commented: (HADOOP-6166) Improve PureJavaCrc32

[ https://issues.apache.org/jira/browse/HADOOP-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735908#action_12735908 ] Scott Carey commented on HADOOP-6166: - For the 32 bit results, try passing -server on

[jira] Commented: (HADOOP-6167) bin/hadoop script doesn't allow for different memory settings for each daemon type

[ https://issues.apache.org/jira/browse/HADOOP-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735884#action_12735884 ] Scott Carey commented on HADOOP-6167: - Having -Xmx listed multiple times is misleading

[jira] Commented: (HADOOP-6166) Improve PureJavaCrc32

[ https://issues.apache.org/jira/browse/HADOOP-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734445#action_12734445 ] Scott Carey commented on HADOOP-6166: - One could take Intel's idea, and go 8 (or 6 or

[jira] Commented: (HADOOP-5318) Poor IO Performance due to AtomicLong operations

[ https://issues.apache.org/jira/browse/HADOOP-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734299#action_12734299 ] Scott Carey commented on HADOOP-5318: - Since the CRC code reaches to near peak through

[jira] Commented: (HADOOP-6148) Implement a pure Java CRC32 calculator

[ https://issues.apache.org/jira/browse/HADOOP-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731752#action_12731752 ] Scott Carey commented on HADOOP-6148: - {quote}It seems to me that, on the 64-bit JVM,

[jira] Commented: (HADOOP-6148) Implement a pure Java CRC32 calculator

[ https://issues.apache.org/jira/browse/HADOOP-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731750#action_12731750 ] Scott Carey commented on HADOOP-6148: - Interesting results. Todd, were you using -serv

[jira] Commented: (HADOOP-6148) Implement a pure Java CRC32 calculator

[ https://issues.apache.org/jira/browse/HADOOP-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731732#action_12731732 ] Scott Carey commented on HADOOP-6148: - {quote} I am using Sun JDK on Windows. {noforma

[jira] Updated: (HADOOP-6148) Implement a pure Java CRC32 calculator

[ https://issues.apache.org/jira/browse/HADOOP-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Carey updated HADOOP-6148: Attachment: TestCrc32Performance.java New test, testing performance of many crc variants and spend

[jira] Updated: (HADOOP-6148) Implement a pure Java CRC32 calculator

[ https://issues.apache.org/jira/browse/HADOOP-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Carey updated HADOOP-6148: Attachment: PureJavaCrc32NewLoop.java PureJavaCrc32NewInner.java Pu

[jira] Commented: (HADOOP-6148) Implement a pure Java CRC32 calculator

[ https://issues.apache.org/jira/browse/HADOOP-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731721#action_12731721 ] Scott Carey commented on HADOOP-6148: - Whatever that Timer class is that is being used

[jira] Commented: (HADOOP-5170) Set max map/reduce tasks on a per-job basis, either per-node or cluster-wide

[ https://issues.apache.org/jira/browse/HADOOP-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12726768#action_12726768 ] Scott Carey commented on HADOOP-5170: - bq. You're right that we can't support Jonathan

[jira] Commented: (HADOOP-6121) High Availability support for Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12726573#action_12726573 ] Scott Carey commented on HADOOP-6121: - {quote}Do you know who is implementing ZK for t

[jira] Commented: (HADOOP-6121) High Availability support for Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12726160#action_12726160 ] Scott Carey commented on HADOOP-6121: - If you really want to go very robust with the J