[jira] [Created] (HADOOP-10752) Add support for hardware crc on ARM aarch64 architecture
Edward Nevill created HADOOP-10752: -- Summary: Add support for hardware crc on ARM aarch64 architecture Key: HADOOP-10752 URL: https://issues.apache.org/jira/browse/HADOOP-10752 Project: Hadoop Common Issue Type: Improvement Components: native, performance Affects Versions: trunk-win Environment: ARM aarch64 Juno development platform Reporter: Edward Nevill Priority: Minor Fix For: trunk-win This patch adds support for hardware crc for ARM's new 64 bit architecture. The patch is completely conditionalized on __arch64__ For the moment I have only done the non pipelined version as the hw I have only has 1 crc execute unit. Some initial benchmarks on terasort give sw crc: 107 sec hw crc: 103 sec The performance improvement is quite small, but this is limited by the fact that I am using early stage hw which is not performant. I have also built it on x86 and I think the change is fairly safe for other architectures because post conditionalization the src is identical on other architectures. This is the first patch I have submitted for Hadoop so I would welcome any feedback and help. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10753) Could be better to move CommonConfigurationKeysPublic to org.apache.hadoop.common package
Kai Zheng created HADOOP-10753: -- Summary: Could be better to move CommonConfigurationKeysPublic to org.apache.hadoop.common package Key: HADOOP-10753 URL: https://issues.apache.org/jira/browse/HADOOP-10753 Project: Hadoop Common Issue Type: Improvement Reporter: Kai Zheng Assignee: Kai Zheng Priority: Minor As discussed in HADOOP-8943, it would be better to place CommonConfigurationKeysPublic into a more neutral place like org.apache.hadoop.common instead of org.apache.hadoop.fs package. This would help common facilities like security related codes coupling with fs stuffs. Could anyone post your thought about this, and if confirmed, I would provide a patch for it. -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: [VOTE] Release Apache Hadoop 2.4.1
+1(non-binding) - Built from source. - Ran tests. -- Reproduced HADOOP-10510 on AWS instance(Ubuntu Server 14.04 LTS (PV) - ami-bddaa2bc (64-bit)). I agree with that this problem will be fixed after releases when voting at 2.4.0. I believe that this problem is environment-depend one. - Deployed single cluster node and ran examples. - Verified signature. Thanks, - Tsuyoshi On Sat, Jun 21, 2014 at 3:51 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created another release candidate (rc1) for hadoop-2.4.1 based on the feedback that I would like to push out. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.4.1-rc1 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.4.1-rc1 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/hdp/ -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- - Tsuyoshi
[jira] [Resolved] (HADOOP-10667) implement TCP connection reuse for native client
[ https://issues.apache.org/jira/browse/HADOOP-10667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HADOOP-10667. --- Resolution: Fixed Fix Version/s: HADOOP-10388 implement TCP connection reuse for native client Key: HADOOP-10667 URL: https://issues.apache.org/jira/browse/HADOOP-10667 Project: Hadoop Common Issue Type: Sub-task Components: native Affects Versions: HADOOP-10388 Reporter: Colin Patrick McCabe Assignee: Colin Patrick McCabe Fix For: HADOOP-10388 Attachments: HADOOP-10667-pnative.001.patch, HADOOP-10667-pnative.002.patch, HADOOP-10667-pnative.003.patch, HADOOP-10667-pnative.004.patch The HDFS / YARN native clients should re-use TCP connections to avoid the overhead of the three-way handshake, similar to how the Java code does. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10757) KeyProvider KeyVersion should provide the key name
Alejandro Abdelnur created HADOOP-10757:
---
Summary: KeyProvider KeyVersion should provide the key name
Key: HADOOP-10757
URL: https://issues.apache.org/jira/browse/HADOOP-10757
Project: Hadoop Common
Issue Type: Improvement
Components: security
Affects Versions: 3.0.0
Reporter: Alejandro Abdelnur
Assignee: Arun Suresh
Currently the {{KeyVersion}} does not provide a way to get the key name to do a
reverse lookup to get the metadata of the key.
For the {{JavaKeyStoreProvider}} and the {{UserProvider}} this is not an issue
because the key name is encoded in the key version name.
This encoding of the key name in the key version name cannot be expected in all
KeyProvider implementations. It is common for key management systems to use
UUID to refer to specific key materials (KeyVersions in Hadoop parlance).
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Created] (HADOOP-10758) KMS: add ACLs on per key basis.
Alejandro Abdelnur created HADOOP-10758: --- Summary: KMS: add ACLs on per key basis. Key: HADOOP-10758 URL: https://issues.apache.org/jira/browse/HADOOP-10758 Project: Hadoop Common Issue Type: Improvement Components: security Affects Versions: 3.0.0 Reporter: Alejandro Abdelnur Assignee: Arun Suresh The KMS server should enforce ACLs on per key basis. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10759) Remove hardcoded JAVA_HEAP_MAX in hadoop-config.sh
sam liu created HADOOP-10759: Summary: Remove hardcoded JAVA_HEAP_MAX in hadoop-config.sh Key: HADOOP-10759 URL: https://issues.apache.org/jira/browse/HADOOP-10759 Project: Hadoop Common Issue Type: Bug Components: bin Affects Versions: 2.4.0 Environment: Linux64 Reporter: sam liu Priority: Trivial In hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh, there is a hard code for Java parameter: 'JAVA_HEAP_MAX=-Xmx1000m'. It should be removed. -- This message was sent by Atlassian JIRA (v6.2#6252)
