I think it'll be useful to have a discussion about what else people would
like to see in Hadoop 3.x - especially if the change is potentially
incompatible. Also, what we expect the release schedule to be for major
releases and what triggers them - JVM version, major features, the need for
incompati
Siddharth Seth created MAPREDUCE-6197:
-
Summary: Cache MapOutputLocations in ShuffleHandler
Key: MAPREDUCE-6197
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6197
Project: Hadoop Map/Reduce
Siddharth Seth created MAPREDUCE-5663:
-
Summary: Add an interface to Input/Ouput Formats to obtain
delegation tokens
Key: MAPREDUCE-5663
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5663
+1 (binding).
Verified signature and checksums.
Built from source and upgraded a 2.0.4 cluster. Ran a couple of simple MR
and Tez jobs.
- Sid
On Thu, Aug 15, 2013 at 2:15 PM, Arun C Murthy wrote:
> Folks,
>
> I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would
> like to
Siddharth Seth created MAPREDUCE-5352:
-
Summary: Optimize node local splits generated by
CombineFileInputFormat
Key: MAPREDUCE-5352
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5352
Siddharth Seth created MAPREDUCE-5301:
-
Summary: Update MR code to work with YARN-635 changes
Key: MAPREDUCE-5301
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5301
Project: Hadoop Map
[
https://issues.apache.org/jira/browse/MAPREDUCE-5291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-5291.
---
Resolution: Fixed
Fix Version/s: 2.1.0-beta
Hadoop Flags: Reviewed
Siddharth Seth created MAPREDUCE-5291:
-
Summary: Change MR App to use update property names in
container-log4j.properties
Key: MAPREDUCE-5291
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5291
[
https://issues.apache.org/jira/browse/MAPREDUCE-5285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-5285.
---
Resolution: Fixed
Fix Version/s: 2.1.0-beta
Committed as part of YARN-735
[
https://issues.apache.org/jira/browse/MAPREDUCE-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-5286.
---
Resolution: Fixed
Fix Version/s: 2.0.5-beta
Hadoop Flags: Reviewed
Siddharth Seth created MAPREDUCE-5286:
-
Summary: startContainer call should use the ContainerToken instead
of Container [YARN-684]
Key: MAPREDUCE-5286
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5286
+1.
On Fri, May 17, 2013 at 2:10 PM, Thomas Graves wrote:
> Hello all,
>
> We've had a few critical issues come up in 0.23.7 that I think warrants a
> 0.23.8 release. The main one is MAPREDUCE-5211. There are a couple of
> other issues that I want finished up and get in before we spin it. Thos
Siddharth Seth created MAPREDUCE-5254:
-
Summary: Fix exception unwrapping and unit tests using
UndeclaredThrowable
Key: MAPREDUCE-5254
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5254
Siddharth Seth created MAPREDUCE-5242:
-
Summary: Remove mapred-default.xml
Key: MAPREDUCE-5242
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5242
Project: Hadoop Map/Reduce
Issue
Siddharth Seth created MAPREDUCE-5221:
-
Summary: Reduce side Combiner is not used when using the new API
Key: MAPREDUCE-5221
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5221
Project
Siddharth Seth created MAPREDUCE-5201:
-
Summary: MRPartitioner should get num partitions from
TezTaskContext
Key: MAPREDUCE-5201
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5201
Project
[
https://issues.apache.org/jira/browse/MAPREDUCE-5181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-5181.
---
Resolution: Fixed
Fix Version/s: 2.0.5-beta
Hadoop Flags: Reviewed
Siddharth Seth created MAPREDUCE-5181:
-
Summary: RMCommunicator should not use AMToken from the env
Key: MAPREDUCE-5181
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5181
Project: Hadoop
+1 (binding).
Verified checksums and signature.
Built from source tar, deployed a single node cluster (CapacityScheduler)
and tried a couple of simple MR jobs.
- Sid
On Thu, Apr 11, 2013 at 12:55 PM, Thomas Graves wrote:
> I've created a release candidate (RC0) for hadoop-0.23.7 that I would li
+1 (binding)
Verified checksums and signatures.
Built from the source tar, deployed a single node cluster and tested a
couple of simple MR jobs.
- Sid
On Fri, Apr 12, 2013 at 2:56 PM, Arun C Murthy wrote:
> Folks,
>
> I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I would
>
I went ahead and committed a couple of changes to trunk and branch-2 to fix
the MR CHANGES.txt mess. Alexandro, I believe there's a couple of jiras
where you were waiting for CHANGES.txt fixes before merging to branch-2.
Not sure about past discussions, but can we re-visit removing CHANGES.txt
in
Arun, MAPREDUCE-5094 would be a useful jira to include in the 2.0.4-alpha
release. It's not an absolute blocker since the values can be controlled
explicitly by changing tests which use the cluster.
Thanks
- Sid
On Tue, Apr 9, 2013 at 8:39 PM, Arun C Murthy wrote:
> Folks,
>
> I've created a r
[
https://issues.apache.org/jira/browse/MAPREDUCE-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth reopened MAPREDUCE-5088:
---
bq. Patch committed to branch-2.0.4-alpha as r1463804. Thanks Daryn!
[~cos], looks
[
https://issues.apache.org/jira/browse/MAPREDUCE-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-5115.
---
Resolution: Duplicate
> MR app master may try to assign a reduce prior
[
https://issues.apache.org/jira/browse/MAPREDUCE-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth reopened MAPREDUCE-5115:
---
> MR app master may try to assign a reduce priority container to a
[
https://issues.apache.org/jira/browse/MAPREDUCE-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-5115.
---
Resolution: Fixed
> MR app master may try to assign a reduce prior
Siddharth Seth created MAPREDUCE-5094:
-
Summary: Disable mem monitoring by default in MiniMRYarnCluster
Key: MAPREDUCE-5094
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5094
Project
Siddharth Seth created MAPREDUCE-5089:
-
Summary: Remove TestProcfsBasedProcessTree from
mapreduce-client-jobclient
Key: MAPREDUCE-5089
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5089
Siddharth Seth created MAPREDUCE-5083:
-
Summary: MiniMRCluster should use a random component when creating
an actual cluster
Key: MAPREDUCE-5083
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5083
Siddharth Seth created MAPREDUCE-5041:
-
Summary: Counters on the UI should be formatted
Key: MAPREDUCE-5041
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5041
Project: Hadoop Map/Reduce
Siddharth Seth created MAPREDUCE-5040:
-
Summary: Make JobId, TaskId, TaskAttemptId immutable
Key: MAPREDUCE-5040
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5040
Project: Hadoop Map
+1.
Verified checksums and signature.
Built from source and deployed on a multi node cluster. Verified with
several MR examples.
- Sid
On Wed, Feb 6, 2013 at 7:59 PM, Arun C Murthy wrote:
> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would
> like to release.
Siddharth Seth created MAPREDUCE-4894:
-
Summary: Renewal / cancellation of JobHistory tokens
Key: MAPREDUCE-4894
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4894
Project: Hadoop Map
[
https://issues.apache.org/jira/browse/MAPREDUCE-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4699.
---
Resolution: Fixed
Fix Version/s: 1.1.2
Hadoop Flags: Reviewed
Siddharth Seth created MAPREDUCE-4738:
-
Summary: [MAPREDUCE-3902] re-enable disabled unit tests in
mr-client-app2 module
Key: MAPREDUCE-4738
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4738
Siddharth Seth created MAPREDUCE-4734:
-
Summary: The history server should link back to NM logs if
aggregation is incomplete / disabled
Key: MAPREDUCE-4734
URL: https://issues.apache.org/jira/browse/MAPREDUCE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4727.
---
Resolution: Fixed
Fix Version/s: MR-3902
Committed to branch MR-3902
Siddharth Seth created MAPREDUCE-4727:
-
Summary: [MAPREDUCE-3902] Handle a successful NM stop request
Key: MAPREDUCE-4727
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4727
Project: Hadoop
Along with fix versions, does it make sense to add JIRAs under 0.23 as well
as branch-2 in CHANGES.txt, if they're committed to both branches.
CHANGES.txt tends to get out of sync with the different release schedules
of the 2 branches.
Thanks
- Sid
On Sat, Sep 29, 2012 at 10:33 PM, Arun C Murthy
[
https://issues.apache.org/jira/browse/MAPREDUCE-4663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4663.
---
Resolution: Fixed
Fix Version/s: MR-3902
> [MAPREDUCE-3902] Contai
[
https://issues.apache.org/jira/browse/MAPREDUCE-4664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4664.
---
Resolution: Fixed
Fix Version/s: MR-3902
> [MAPREDUCE-3
[
https://issues.apache.org/jira/browse/MAPREDUCE-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4665.
---
Resolution: Fixed
Fix Version/s: MR-3902
> [MAPREDUCE-3902] Use
[
https://issues.apache.org/jira/browse/MAPREDUCE-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4618.
---
Resolution: Fixed
Fix Version/s: MR-3902
Assignee: Siddharth Seth
Siddharth Seth created MAPREDUCE-4665:
-
Summary: [MAPREDUCE-3902] Use the configured shuffle port and
application ACLs
Key: MAPREDUCE-4665
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4665
Siddharth Seth created MAPREDUCE-4664:
-
Summary: [MAPREDUCE-3902] ContainerHeartbeatHandler should be
pinged on a getTask call
Key: MAPREDUCE-4664
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4664
Siddharth Seth created MAPREDUCE-4663:
-
Summary: Container Launch should be independent of o.a.h.m.Task
Key: MAPREDUCE-4663
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4663
Project
[
https://issues.apache.org/jira/browse/MAPREDUCE-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4621.
---
Resolution: Duplicate
Fix Version/s: MR-3902
Fixed as part of MAPREDUCE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4617.
---
Resolution: Fixed
Fix Version/s: MR-3902
Committed to branch MR-3902
[
https://issues.apache.org/jira/browse/MAPREDUCE-4626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4626.
---
Resolution: Fixed
Fix Version/s: MR-3902
Committed to the MR-3902 branch
[
https://issues.apache.org/jira/browse/MAPREDUCE-4620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4620.
---
Resolution: Fixed
Fix Version/s: MR-3902
> [MAPREDUCE-3
[
https://issues.apache.org/jira/browse/MAPREDUCE-4619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4619.
---
Resolution: Fixed
Fix Version/s: MR-3902
Hadoop Flags: Reviewed
[
https://issues.apache.org/jira/browse/MAPREDUCE-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4624.
---
Resolution: Fixed
Fix Version/s: MR-3902
> [MAPREDUCE-3902] Red
[
https://issues.apache.org/jira/browse/MAPREDUCE-4625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4625.
---
Resolution: Fixed
Fix Version/s: MR-3902
> [MAPREDUCE-3
Siddharth Seth created MAPREDUCE-4627:
-
Summary: [MAPREDUCE-3902] Handle the JobFinishedEvent correctly
Key: MAPREDUCE-4627
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4627
Project
Siddharth Seth created MAPREDUCE-4626:
-
Summary: [MAPREDUCE-3902] Fix and re-enable RMContaienrAllocator
unit tests
Key: MAPREDUCE-4626
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4626
Siddharth Seth created MAPREDUCE-4625:
-
Summary: [MAPREDUCE-3902] Statistics logging in the AM scheduler
Key: MAPREDUCE-4625
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4625
Project
Siddharth Seth created MAPREDUCE-4624:
-
Summary: [MAPREDUCE-3902] Reduce scheduling fixes, factor in
MR-4437
Key: MAPREDUCE-4624
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4624
Project
Siddharth Seth created MAPREDUCE-4623:
-
Summary: [MAPREDUCE-3902] Unit tests for AMNode
Key: MAPREDUCE-4623
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4623
Project: Hadoop Map/Reduce
Siddharth Seth created MAPREDUCE-4622:
-
Summary: [MAPREDUCE-3902] Unit tests for AMContainer
Key: MAPREDUCE-4622
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4622
Project: Hadoop Map
Siddharth Seth created MAPREDUCE-4621:
-
Summary: [MAPREDUCE-3902] Disable AM blacklisting if
#blacklistedNodes crosses the configured threshold
Key: MAPREDUCE-4621
URL: https://issues.apache.org/jira/browse
Siddharth Seth created MAPREDUCE-4620:
-
Summary: [MAPREDUCE-3902] RMContainerAllocator should factor in
nodes being blacklisted
Key: MAPREDUCE-4620
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4620
Siddharth Seth created MAPREDUCE-4618:
-
Summary: [MAPREDUCE-3902] Re-wire LocalContainerAllocator / UberAM
Key: MAPREDUCE-4618
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4618
Project
Siddharth Seth created MAPREDUCE-4619:
-
Summary: [MAPREDUCE-3902] Change AMContainerMap to extend
AbstractService
Key: MAPREDUCE-4619
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4619
Siddharth Seth created MAPREDUCE-4617:
-
Summary: [MAPREDUCE-3902] Re-wire AM Recovery
Key: MAPREDUCE-4617
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4617
Project: Hadoop Map/Reduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4609.
---
Resolution: Fixed
Fix Version/s: MR-3902
Hadoop Flags: Reviewed
[
https://issues.apache.org/jira/browse/MAPREDUCE-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4599.
---
Resolution: Fixed
Fix Version/s: MR-3902
Hadoop Flags: Reviewed
[
https://issues.apache.org/jira/browse/MAPREDUCE-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4602.
---
Resolution: Fixed
Fix Version/s: MR-3902
> [MAPREDUCE-3902] Re-cre
Siddharth Seth created MAPREDUCE-4602:
-
Summary: [MAPREDUCE-3902] Re-create ask list correctly in case of
a temporary error in the AM-RM allocate call
Key: MAPREDUCE-4602
URL: https://issues.apache.org/jira
Siddharth Seth created MAPREDUCE-4596:
-
Summary: Split StateMachine state from states seen by
MRClientProtocol (for Job, Task, TaskAttempt)
Key: MAPREDUCE-4596
URL: https://issues.apache.org/jira/browse
es I have and help to fix TODOs against the new
> branch.
> >
> > - Tsuyoshi
> >
> > On Thursday, August 23, 2012, Siddharth Seth wrote:
> >>
> >> I've created a branch to continue work on MAPREDUE-3902 since the
> changes
> >> are reasonably
I've created a branch to continue work on MAPREDUE-3902 since the changes
are reasonably big and intrusive. A branch should also make it easier for
others to contribute to the JIRA.
Will send out another mail at a later point for review requests, once this
is closer to completion. Meanwhile, if any
[
https://issues.apache.org/jira/browse/MAPREDUCE-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-4558.
---
Resolution: Fixed
Fix Version/s: 1.2.0
Hadoop Flags: Reviewed
Siddharth Seth created MAPREDUCE-4563:
-
Summary: TestJobTrackerSafeMode creates cyclic symlinks
Key: MAPREDUCE-4563
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4563
Project: Hadoop Map
Siddharth Seth created MAPREDUCE-4558:
-
Summary: TestJobTrackerSafeMode is failing
Key: MAPREDUCE-4558
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4558
Project: Hadoop Map/Reduce
Siddharth Seth created MAPREDUCE-4425:
-
Summary: Speculation + Fetch failures can lead to a hung job
Key: MAPREDUCE-4425
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4425
Project: Hadoop
Siddharth Seth created MAPREDUCE-4336:
-
Summary: Distributed Shell fails when used with the
CapacityScheduler
Key: MAPREDUCE-4336
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4336
Project
Siddharth Seth created MAPREDUCE-4335:
-
Summary: Change the default scheduler to the CapacityScheduler
Key: MAPREDUCE-4335
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4335
Project: Hadoop
Components: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Currently, delegation tokens issues by the RM and History server cannot be
renewed or cancelled. This needs to be implemented.
--
This message is automatically generated by JIRA.
If you think it was sent
[
https://issues.apache.org/jira/browse/MAPREDUCE-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth resolved MAPREDUCE-3908.
---
Resolution: Duplicate
Target Version/s: 0.23.3, 2.0.0, 3.0.0 (was
[
https://issues.apache.org/jira/browse/MAPREDUCE-4099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth reopened MAPREDUCE-4099:
---
Things will continue to work because of the sleep - so leaving it in should be
ok
Issue Type: Bug
Components: mrv2, scheduler
Affects Versions: 0.23.1
Reporter: Siddharth Seth
Assignee: Siddharth Seth
Priority: Critical
CS is supposed to be allocating a single off-switch container per node
heartbeat (MAPREDUCE-3641
-3979
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3979
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, resourcemanager
Affects Versions: 1.0.0, 0.23.0
Reporter: Siddharth Seth
The first Job/App to register a token
Issue Type: Bug
Components: job submission, mrv1
Affects Versions: 0.23.1
Reporter: Siddharth Seth
These are currently returning the number of completed map / reduce tasks -
instead of the total. The information doesn't make it over to the history
server via th
Reporter: Siddharth Seth
Assignee: Siddharth Seth
Map/ReduceSlot millis are currently computed based on a fixed container size.
They should instead be based on the minimum container size offered by the
cluster.
There's another jira to rename these Counters - based o
: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Assignee: Siddharth Seth
Currently, if log aggregation is enabled for a cluster - logs for all jobs will
be aggregated - leading to a whole bunch of files on hdfs which users may not
want.
Users should be able to
Components: jobhistoryserver, mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Assignee: Siddharth Seth
The job history UI and MRClientProtocol calls routed via JobHistory are very
slow for large jobs. Some of this time is spent parsing the history file. A
good
://issues.apache.org/jira/browse/MAPREDUCE-3834
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Priority: Critical
Should be added only once - so that the RM doesn't think th
Issue Type: Sub-task
Components: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Priority: Critical
BlockLocation.getHosts() returns IP addresses occasionally. Data locality is
affected - since the RM requires hostnames.
--
This message is
: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Assignee: Siddharth Seth
Priority: Critical
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org
Components: mrv2
Affects Versions: 1.0.0, 0.23.1
Reporter: Siddharth Seth
Assignee: Siddharth Seth
Priority: Blocker
Task.TaskReporter.stopCommunicationThread can end up waiting for a
thread.sleep(3000) before stopping the thread.
--
This message is
Components: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Priority: Blocker
This was while running LoadGen.
{noformat}
Error: java.lang.NullPointerException at
org.apache.hadoop.fs.Path.(Path.java:67)
at org.apache.hadoop.fs.Path.(Path.java:56)
at
oject: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Priority: Critical
MutableGaugeInt incremented as {{allocatedGB.incr(res.getMemory() / GB *
containers);}}
Setting yarn.scheduler.capacity.mi
Versions: 0.23.0
Reporter: Siddharth Seth
Assignee: Siddharth Seth
Priority: Blocker
If all current {{Fetcher}}s complete while an in-memory merge is in progress -
shuffle could hang.
Specifically - if the memory freed by an in-memory merge does not bring
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Priority: Blocker
With multiple jobs submitted per user, and multiple users submitting jobs - the
headroom reported to the AppMasters is incorrect (very high).
Leads to a deadlock - reduces started, map tasks not complete
Components: mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Priority: Critical
Reported by [~karams]
yarn.resourcemanager.am.max-retries=2
Ran test cases with sort job on 350 scale having 16800 maps and 680 reduces -:
1. After 70 secs of Job Sumbission
: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv1, mrv2
Affects Versions: 1.0.0, 0.23.0
Reporter: Siddharth Seth
Assignee: Siddharth Seth
The last split generated by FileInputFormat.getSplits considers
{{blkLocations.length-1}} to be the hosts for
Components: mrv2
Affects Versions: 0.23.1
Reporter: Siddharth Seth
Priority: Blocker
{noformat}
12/01/19 02:56:22 ERROR security.UserGroupInformation:
PriviledgedActionException as:XXX@XXX(auth:KERBEROS) cause:java.io.IOException:
Failed to specify server&#
Components: mrv2, nodemanager
Affects Versions: 0.23.0
Reporter: Siddharth Seth
Observed while looking at MAPREDUCE-3596 and MAPREDUCE-3656.
startContainer taking over a minute in some cases, otherwise 15 seconds. Both
were observed soon after reduce tasks started. Network
Issue Type: Task
Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Siddharth Seth
The TaskAttemptListener currently accepts TaskUmbilical calls from tasks which
may have already been unregistered and processes updates. It should just send
back Exceptions so
Issue Type: Bug
Components: mrv2
Reporter: Siddharth Seth
Priority: Critical
Currently, if the JobHistory file has a partial record, AMRecovery will start
from scratch. This will become more relevant after MAPREDUCE-3512.
--
This message is automatically
1 - 100 of 154 matches
Mail list logo
