[jira] [Created] (HADOOP-10556) Add toLowerCase support to auth_to_local rules for service name

2014-04-30 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HADOOP-10556:
---

 Summary: Add toLowerCase support to auth_to_local rules for 
service name
 Key: HADOOP-10556
 URL: https://issues.apache.org/jira/browse/HADOOP-10556
 Project: Hadoop Common
  Issue Type: Improvement
  Components: security
Affects Versions: 2.4.0
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur


When using Vintela to integrate Linux with AD, principals are lowercased. If 
the accounts in AD have uppercase characters (ie FooBar) the Kerberos 
principals have also uppercase characters (ie FooBar/). Because of this, 
when a service (Yarn/HDFS) extracts the service name from the Kerberos 
principal (FooBar) and uses it for obtain groups the user is not found because 
via Linux the user FooBar is unknown, it has been converted to foobar.




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Resolved] (HADOOP-10389) Native RPCv9 client

2014-04-30 Thread Colin Patrick McCabe (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Colin Patrick McCabe resolved HADOOP-10389.
---

Resolution: Fixed

committed to branch

> Native RPCv9 client
> ---
>
> Key: HADOOP-10389
> URL: https://issues.apache.org/jira/browse/HADOOP-10389
> Project: Hadoop Common
>  Issue Type: Sub-task
>Affects Versions: HADOOP-10388
>Reporter: Binglin Chang
>Assignee: Colin Patrick McCabe
> Attachments: HADOOP-10388.001.patch, HADOOP-10389.002.patch, 
> HADOOP-10389.004.patch, HADOOP-10389.005.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HADOOP-10555) add offset support to MurmurHash

2014-04-30 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HADOOP-10555:
-

 Summary: add offset support to MurmurHash
 Key: HADOOP-10555
 URL: https://issues.apache.org/jira/browse/HADOOP-10555
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Sergey Shelukhin
Priority: Trivial


>From HIVE-6430 code review



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HADOOP-10554) Performance: Scan metrics for 2.4 are notably down compared to 0.23.9

2014-04-30 Thread patrick white (JIRA)
patrick white created HADOOP-10554:
--

 Summary: Performance: Scan metrics for 2.4 are notably down 
compared to 0.23.9
 Key: HADOOP-10554
 URL: https://issues.apache.org/jira/browse/HADOOP-10554
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 2.4.0
Reporter: patrick white


Performance comparison benchmarks for Scan test's runtime and throughput 
metrics are slightly out of 5% tolerance in 2.x compared against 0.23. The 
trend is consistent across later releases in both lines, latest release numbers 
are;

Runtime:
2.4.0.0 ->73.6 seconds (avg 5 passes)
0.23.9.12 ->69.4 seconds (avg 5 passes)
Diff: -5.7%

Throughput:
2.4.0.0 ->   28.67 GB/s (avg 5 passes)
0.23.9.12 ->  30.41 GB/s (avg 5 passes)
Diff: -6.1%

Scan test is specifically measuring the average map's input read performance. 
The diff is consistent when run on a larger (350 node) perf environment, we are 
in process of seeing if this reproduces in a smaller cluster, using 
appropriately scaled inputs.




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HADOOP-10553) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2014-04-30 Thread patrick white (JIRA)
patrick white created HADOOP-10553:
--

 Summary: Performance: AM scaleability is 10% slower in 2.4 
compared to 0.23.9
 Key: HADOOP-10553
 URL: https://issues.apache.org/jira/browse/HADOOP-10553
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 2.4.0
Reporter: patrick white


Performance comparison benchmarks from 2.x against 0.23 shows AM scalability 
benchmark's runtime is approximately 10% slower in 2.4.0. The trend is 
consistent across later releases in both lines, latest release numbers are:

2.4.0.0 runtime 255.6 seconds (avg 5 passes)
0.23.9.12 runtime 230.4 seconds (avg 5 passes)
Diff: -9.9% 

AM Scalability test is essentially a sleep job that measures time to launch and 
complete a large number of mappers.

The diff is consistent and has been reproduced in both a larger (350 node, 
100,000 mappers) perf environment, as well as a small (10 node, 2,900 mappers) 
demo cluster.




--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HADOOP-10552) Fix usage and example at FileSystemShell.apt.vm

2014-04-30 Thread Kenji Kikushima (JIRA)
Kenji Kikushima created HADOOP-10552:


 Summary: Fix usage and example at FileSystemShell.apt.vm
 Key: HADOOP-10552
 URL: https://issues.apache.org/jira/browse/HADOOP-10552
 Project: Hadoop Common
  Issue Type: Bug
  Components: documentation
Affects Versions: 2.4.0
Reporter: Kenji Kikushima
Priority: Trivial


Usage at moveFromLocal needs "hdfs" command, and example for touchz should use 
"hdfs dfs".




--
This message was sent by Atlassian JIRA
(v6.2#6252)