[jira] [Created] (HADOOP-11299) Selective Group Cache Refresh
Chris Li created HADOOP-11299: - Summary: Selective Group Cache Refresh Key: HADOOP-11299 URL: https://issues.apache.org/jira/browse/HADOOP-11299 Project: Hadoop Common Issue Type: New Feature Reporter: Chris Li Assignee: Chris Li Priority: Minor Currently groups can be refreshed via dfsadmin -refreshUserToGroupMappings, but this places an undue stress on LDAP if we clear everything at once, where we may only want to refresh a single user. This feature would allow the admin to specify a list of users to refresh. Passing arguments is a feature of HADOOP-10376 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HADOOP-10283) Make Scheduler and Multiplexer swappable
[ https://issues.apache.org/jira/browse/HADOOP-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li resolved HADOOP-10283. --- Resolution: Not a Problem Resolved in HADOOP-10282 Make Scheduler and Multiplexer swappable Key: HADOOP-10283 URL: https://issues.apache.org/jira/browse/HADOOP-10283 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li Assignee: Chris Li Priority: Minor Currently the FairCallQueue uses the DecayRpcScheduler RoundRobinMultiplexer, this task is to allow the user to configure the scheduler and mux in config settings -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HADOOP-10284) Add metrics to the HistoryRpcScheduler
[ https://issues.apache.org/jira/browse/HADOOP-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li resolved HADOOP-10284. --- Resolution: Not a Problem Assignee: Chris Li Resolved in HADOOP-10281 Add metrics to the HistoryRpcScheduler -- Key: HADOOP-10284 URL: https://issues.apache.org/jira/browse/HADOOP-10284 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li Assignee: Chris Li -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-10825) Refactor class creation logic in Configuration into nested class
Chris Li created HADOOP-10825: - Summary: Refactor class creation logic in Configuration into nested class Key: HADOOP-10825 URL: https://issues.apache.org/jira/browse/HADOOP-10825 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li Assignee: Chris Li Priority: Minor This first patch refactors class creation inside Configuration into a nested class called ClassCreator (a pretty uninspired name; I’m up for better naming suggestions). Since this is a refactor that adds no new features, I have not included a test. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10811) Allow classes to be reloaded at runtime
Chris Li created HADOOP-10811: - Summary: Allow classes to be reloaded at runtime Key: HADOOP-10811 URL: https://issues.apache.org/jira/browse/HADOOP-10811 Project: Hadoop Common Issue Type: New Feature Components: conf Affects Versions: 3.0.0 Reporter: Chris Li Assignee: Chris Li Priority: Minor Currently hadoop loads its classes and caches them in the Configuration class. Even if the user swaps a class's jar at runtime, hadoop will continue to use the cached classes when using reflection to instantiate objects. This limits the usefulness of things like HADOOP-10285, because the admin would need to restart each time they wanted to change their queue class. This patch is to add a way to refresh the class cache, by creating a new refresh handler to do so (using HADOOP-10376) -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10685) Move RefreshCallQueue from its own protocol to the GenericRefreshProto
Chris Li created HADOOP-10685: - Summary: Move RefreshCallQueue from its own protocol to the GenericRefreshProto Key: HADOOP-10685 URL: https://issues.apache.org/jira/browse/HADOOP-10685 Project: Hadoop Common Issue Type: Improvement Reporter: Chris Li Assignee: Chris Li Priority: Minor -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10508) RefreshCallQueue fails when authorization is enabled
Chris Li created HADOOP-10508: - Summary: RefreshCallQueue fails when authorization is enabled Key: HADOOP-10508 URL: https://issues.apache.org/jira/browse/HADOOP-10508 Project: Hadoop Common Issue Type: Bug Components: ipc Affects Versions: 2.4.0 Reporter: Chris Li Assignee: Chris Li When hadoop.security.authorization=true, the callqueue cannot be refreshed with hadoop dfsadmin -refreshCallQueue (protocol not found). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol
Chris Li created HADOOP-10376: - Summary: Refactor refresh*Protocols into a single generic refreshConfigProtocol Key: HADOOP-10376 URL: https://issues.apache.org/jira/browse/HADOOP-10376 Project: Hadoop Common Issue Type: Improvement Reporter: Chris Li Assignee: Chris Li Priority: Minor See https://issues.apache.org/jira/browse/HADOOP-10285 There are starting to be too many refresh*Protocols We can refactor them to use a single protocol with a variable payload to choose what to do. Thereafter, we can return an indication of success or failure. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10377) End to End test case for refreshing call queue
Chris Li created HADOOP-10377: - Summary: End to End test case for refreshing call queue Key: HADOOP-10377 URL: https://issues.apache.org/jira/browse/HADOOP-10377 Project: Hadoop Common Issue Type: Test Reporter: Chris Li Assignee: Chris Li Priority: Minor See https://issues.apache.org/jira/browse/HADOOP-10285 Once we have the capability of returning errors from the generic refresh config protocol, we can have an integration test of the features. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10369) hadoop fs -ls prints Found 1 items for each entry when globbing
Chris Li created HADOOP-10369:
-
Summary: hadoop fs -ls prints Found 1 items for each entry when
globbing
Key: HADOOP-10369
URL: https://issues.apache.org/jira/browse/HADOOP-10369
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 2.3.0
Reporter: Chris Li
Priority: Minor
{noformat}
-sh-4.1$ hadoop fs -ls /user/chrili/books/84*
Found 1 items
-rw-r--r-- 3 chrili gid-chrili 142382 2014-02-25 18:30
/user/chrili/books/844.other
Found 1 items
-rwxr-xr-x 3 chrili gid-chrili 142382 2013-09-24 10:47
/user/chrili/books/844.txt.utf-8
{noformat}
This behavior is new to 2.0. In 1.X it would not print this at all:
{noformat}
-sh-4.1$ hadoop fs -ls /user/chrili/books/84*
-rw-r--r-- 3 chrili gid-chrili 142382 2014-02-25 18:30
/user/chrili/books/844.other
-rwxr-xr-x 3 chrili gid-chrili 142382 2013-09-24 10:47
/user/chrili/books/844.txt.utf-8
{noformat}
We can workaround this today by filtering with grep first, but I don't think
this is the sort of thing that should be printed to stdout in the first place.
Seems like it would be more appropriate to output to stderr.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
[jira] [Resolved] (HADOOP-10302) Allow CallQueue impls to be swapped at runtime (part 1: internals) Depends on: subtask1
[ https://issues.apache.org/jira/browse/HADOOP-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li resolved HADOOP-10302. --- Resolution: Not A Problem Allow CallQueue impls to be swapped at runtime (part 1: internals) Depends on: subtask1 --- Key: HADOOP-10302 URL: https://issues.apache.org/jira/browse/HADOOP-10302 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li Attachments: HADOOP-10302.patch We wish to swap the active call queue during runtime in order to do performance tuning without restarting the namenode. This patch adds only the internals necessary to swap. Part 2 will add a user interface so that it can be used. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10302) Allow CallQueue impls to be swapped at runtime (part 1: internals)
Chris Li created HADOOP-10302: - Summary: Allow CallQueue impls to be swapped at runtime (part 1: internals) Key: HADOOP-10302 URL: https://issues.apache.org/jira/browse/HADOOP-10302 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10278) Refactor to make CallQueue pluggable
Chris Li created HADOOP-10278: - Summary: Refactor to make CallQueue pluggable Key: HADOOP-10278 URL: https://issues.apache.org/jira/browse/HADOOP-10278 Project: Hadoop Common Issue Type: Sub-task Components: ipc Reporter: Chris Li * Refactor CallQueue into an interface, base, and default implementation that matches today's behavior * Make the call queue impl configurable, keyed on port so that we minimize coupling -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10279) Create multiplexer, a requirement for the fair queue
Chris Li created HADOOP-10279: - Summary: Create multiplexer, a requirement for the fair queue Key: HADOOP-10279 URL: https://issues.apache.org/jira/browse/HADOOP-10279 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10280) Make Schedulables return a configurable identity of user or group
Chris Li created HADOOP-10280: - Summary: Make Schedulables return a configurable identity of user or group Key: HADOOP-10280 URL: https://issues.apache.org/jira/browse/HADOOP-10280 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level
Chris Li created HADOOP-10281: - Summary: Create a scheduler, which assigns schedulables a priority level Key: HADOOP-10281 URL: https://issues.apache.org/jira/browse/HADOOP-10281 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10283) Add metrics to the FairCallQueue
Chris Li created HADOOP-10283: - Summary: Add metrics to the FairCallQueue Key: HADOOP-10283 URL: https://issues.apache.org/jira/browse/HADOOP-10283 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls
Chris Li created HADOOP-10282: - Summary: Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls Key: HADOOP-10282 URL: https://issues.apache.org/jira/browse/HADOOP-10282 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10284) Add metrics to the HistoryRpcScheduler
Chris Li created HADOOP-10284: - Summary: Add metrics to the HistoryRpcScheduler Key: HADOOP-10284 URL: https://issues.apache.org/jira/browse/HADOOP-10284 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10285) Allow CallQueue impls to be swapped at runtime
Chris Li created HADOOP-10285: - Summary: Allow CallQueue impls to be swapped at runtime Key: HADOOP-10285 URL: https://issues.apache.org/jira/browse/HADOOP-10285 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HADOOP-10286) Allow RPCCallBenchmark to benchmark calls by different users
Chris Li created HADOOP-10286: - Summary: Allow RPCCallBenchmark to benchmark calls by different users Key: HADOOP-10286 URL: https://issues.apache.org/jira/browse/HADOOP-10286 Project: Hadoop Common Issue Type: Sub-task Reporter: Chris Li -- This message was sent by Atlassian JIRA (v6.1.5#6160)
