[jira] [Resolved] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-6052. --- Resolution: Fixed > Support overriding log4j.properties per job >

[jira] [Updated] (MAPREDUCE-6149) Document override log4j.properties in MR job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6149: -- Description: This new feature comes from MAPREDUCE-6052, some documentation requirements fr

[jira] [Created] (MAPREDUCE-6149) Document override log4j.properties in MR job

Junping Du created MAPREDUCE-6149: - Summary: Document override log4j.properties in MR job Key: MAPREDUCE-6149 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6149 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14193689#comment-14193689 ] Junping Du commented on MAPREDUCE-6052: --- Thanks [~vinodkv] for comments! bq. Use

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14192957#comment-14192957 ] Junping Du commented on MAPREDUCE-6052: --- bq. In copyAndConfigureFiles, the follo

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Attachment: MAPREDUCE-6052-v4.patch > Support overriding log4j.properties per job >

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191568#comment-14191568 ] Junping Du commented on MAPREDUCE-6052: --- bq. I don't see any. Only some deprecat

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191561#comment-14191561 ] Junping Du commented on MAPREDUCE-6052: --- Thanks for review and comments, [~zjshe

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Status: Patch Available (was: Open) Thanks [~vinodkv] for review and comments! I move the J

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: MAPREDUCE-6146.patch > Reduce tar ball size for MR over distributed cache >

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: (was: MAPREDUCE-6146.patch) > Reduce tar ball size for MR over distributed c

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: MAPREDUCE-6146.patch > Reduce tar ball size for MR over distributed cache >

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: (was: MAPREDUCE-6146.patch) > Reduce tar ball size for MR over distributed c

[jira] [Updated] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6146: -- Attachment: MAPREDUCE-6146.patch > Reduce tar ball size for MR over distributed cache >

[jira] [Moved] (MAPREDUCE-6146) Reduce tar ball size for MR over distributed cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved HADOOP-11177 to MAPREDUCE-6146: Component/s: (was: build) build

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14184118#comment-14184118 ] Junping Du commented on MAPREDUCE-6052: --- Sounds good. In v3 patch, implement mos

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Attachment: MAPREDUCE-6052-v3.patch > Support overriding log4j.properties per job >

[jira] [Updated] (MAPREDUCE-6126) (Rumen) Rumen tool returns error "ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type"

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6126: -- Attachment: MAPREDUCE-6126-v2.patch > (Rumen) Rumen tool returns error "ava.lang.IllegalArgu

[jira] [Commented] (MAPREDUCE-6126) (Rumen) Rumen tool returns error "ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type"

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179537#comment-14179537 ] Junping Du commented on MAPREDUCE-6126: --- Thanks [~jianhe] for review and comment

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179464#comment-14179464 ] Junping Du commented on MAPREDUCE-6052: --- bq. That or "hey this is my log4j confi

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Attachment: MAPREDUCE-6052-v2.patch > Support overriding log4j.properties per job >

[jira] [Commented] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178488#comment-14178488 ] Junping Du commented on MAPREDUCE-6052: --- bq. Was asked to comment. This makes se

[jira] [Updated] (MAPREDUCE-6126) (Rumen) Rumen tool returns error "ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type"

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6126: -- Status: Patch Available (was: Open) > (Rumen) Rumen tool returns error "ava.lang.IllegalArg

[jira] [Updated] (MAPREDUCE-6126) (Rumen) Rumen tool returns error "ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type"

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6126: -- Attachment: MAPREDUCE-6126.patch > (Rumen) Rumen tool returns error "ava.lang.IllegalArgumen

[jira] [Commented] (MAPREDUCE-6126) (Rumen) Rumen tool returns error "ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type"

[ https://issues.apache.org/jira/browse/MAPREDUCE-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165289#comment-14165289 ] Junping Du commented on MAPREDUCE-6126: --- Like MAPREDUCE-3241, NormalizedResource

[jira] [Created] (MAPREDUCE-6126) (Rumen) Rumen tool returns error "ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type"

Junping Du created MAPREDUCE-6126: - Summary: (Rumen) Rumen tool returns error "ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type" Key: MAPREDUCE-6126 URL: https://issues.apac

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Attachment: MAPREDUCE-5831-v3.patch Thanks [~zjshen] for review and comments. v3 patch just

[jira] [Commented] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148477#comment-14148477 ] Junping Du commented on MAPREDUCE-5831: --- bq. It's fine too. If so, we need to fi

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Attachment: MAPREDUCE-5831-v2.patch > Old MR client is not compatible with new MR applicatio

[jira] [Commented] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147948#comment-14147948 ] Junping Du commented on MAPREDUCE-5831: --- Thanks [~zjshen] for review and comment

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Status: Patch Available (was: Open) > Old MR client is not compatible with new MR applicati

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Attachment: MAPREDUCE-5831.patch Upload a patch to fix this issue. > Old MR client is not c

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Issue Type: Sub-task (was: Improvement) Parent: MAPREDUCE-4150 > Improved shuffle e

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139511#comment-14139511 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for reviewing the patch

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v6.patch > Improved shuffle error handling across NM restarts > -

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v5.patch Fix the default value as discussion above in v5 patch.

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14137615#comment-14137615 ] Junping Du commented on MAPREDUCE-5891: --- Sorry for coming a little late as busy

[jira] [Updated] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5831: -- Priority: Blocker (was: Critical) > Old MR client is not compatible with new MR application

[jira] [Commented] (MAPREDUCE-5831) Old MR client is not compatible with new MR application

[ https://issues.apache.org/jira/browse/MAPREDUCE-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136315#comment-14136315 ] Junping Du commented on MAPREDUCE-5831: --- Taking it over and mark this as blocker

[jira] [Updated] (MAPREDUCE-6084) Load MR Configuration from distributed cache rather than individual node

[ https://issues.apache.org/jira/browse/MAPREDUCE-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6084: -- Attachment: Compatibility of Configuration Across Different MR Versions.pdf > Load MR Config

[jira] [Created] (MAPREDUCE-6084) Load MR Configuration from distributed cache rather than individual node

Junping Du created MAPREDUCE-6084: - Summary: Load MR Configuration from distributed cache rather than individual node Key: MAPREDUCE-6084 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6084 Proj

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14125114#comment-14125114 ] Junping Du commented on MAPREDUCE-5891: --- Hi [~jlowe] and [~mingma], any addition

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120850#comment-14120850 ] Junping Du commented on MAPREDUCE-5891: --- Thanks for comments, [~mingma] and [~jl

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v4.patch > Improved shuffle error handling across NM restarts > -

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v3.patch > Improved shuffle error handling across NM restarts >

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116244#comment-14116244 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for comments! bq. SHUFF

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-v2.patch Thanks [~jlowe] for review and comments! In v2 patch, I

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Status: Patch Available (was: Open) > Support overriding log4j.properties per job > --

[jira] [Updated] (MAPREDUCE-6052) Support overriding log4j.properties per job

[ https://issues.apache.org/jira/browse/MAPREDUCE-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6052: -- Attachment: MAPREDUCE-6052.patch Attache a quick patch to fix it. > Support overriding log

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110947#comment-14110947 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for review! I just upda

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Status: Patch Available (was: Open) > Improved shuffle error handling across NM restarts >

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891.patch > Improved shuffle error handling across NM restarts > ---

[jira] [Created] (MAPREDUCE-6052) Support overriding log4j.properties per job

Junping Du created MAPREDUCE-6052: - Summary: Support overriding log4j.properties per job Key: MAPREDUCE-6052 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6052 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106341#comment-14106341 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for quickly feedback! b

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-demo.patch Thanks [~jlowe] for sharing the thoughts. I have a de

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14101731#comment-14101731 ] Junping Du commented on MAPREDUCE-5891: --- Hi [~jlowe], I like to work on this if

[jira] [Created] (MAPREDUCE-6023) Fix SuppressWarnings from "unchecked" to "rawtypes" in O.A.H.mapreduce.lib.input.TaggedInputSplit

Junping Du created MAPREDUCE-6023: - Summary: Fix SuppressWarnings from "unchecked" to "rawtypes" in O.A.H.mapreduce.lib.input.TaggedInputSplit Key: MAPREDUCE-6023 URL: https://issues.apache.org/jira/browse/MAPREDU

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963-v2.1.patch In latest patch, fix the findbug warning. > ShuffleH

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Status: Patch Available (was: Open) > ShuffleHandler DB schema should be versioned with co

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963-v2.patch Update patch to latest trunk and do some fix on visibil

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963.patch Upload a draft patch. It should need some code in YARN-204

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Issue Type: Sub-task (was: New Feature) Parent: MAPREDUCE-4150 > ShuffleHandler DB

[jira] [Moved] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-2265 to MAPREDUCE-5963: - Component/s: (was: nodemanager) Target Version/s: 2.6.0

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14052116#comment-14052116 ] Junping Du commented on MAPREDUCE-5940: --- Kick off Jenkins test. Patch looks good

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051345#comment-14051345 ] Junping Du commented on MAPREDUCE-5940: --- bq. Silently making the elapsed time as

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051048#comment-14051048 ] Junping Du commented on MAPREDUCE-5940: --- Also adding a test in TestTimes.java co

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051046#comment-14051046 ] Junping Du commented on MAPREDUCE-5940: --- Thanks [~zjshen] to work on this and [~

[jira] [Updated] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5861: -- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch Avail

[jira] [Updated] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5861: -- Issue Type: Improvement (was: Bug) > finishedSubMaps field in LocalContainerLauncher does

[jira] [Commented] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996234#comment-13996234 ] Junping Du commented on MAPREDUCE-5861: --- Agree volatile is not help here so bett

[jira] [Commented] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13820906#comment-13820906 ] Junping Du commented on MAPREDUCE-5593: --- The test failure seems to be unrelated

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Status: Open (was: Patch Available) > Cleanup code for AssignMapsWithLocality() in RMConta

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Attachment: MAPREDUCE-5593-v4.patch Sync patch with recently trunk branch. > Cleanup code

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Attachment: MAPREDUCE-5593-v3.patch rename the patch to "MAPREDUCE" in v3 patch and submit

[jira] [Moved] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-1163 to MAPREDUCE-5593: - Component/s: (was: applications) applicationmaste

[jira] [Commented] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

[ https://issues.apache.org/jira/browse/MAPREDUCE-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792110#comment-13792110 ] Junping Du commented on MAPREDUCE-4900: --- Thanks Binglin for the patch and effort

[jira] [Updated] (MAPREDUCE-5301) Update MR code to work with YARN-635 changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5301: -- Assignee: Siddharth Seth > Update MR code to work with YARN-635 changes > -

[jira] [Commented] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13721341#comment-13721341 ] Junping Du commented on MAPREDUCE-5421: --- Thanks Vinod and Xuan for review!

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Attachment: MAPREDUCE-5421-v2.patch The ApplicationNotFoundException in server side should

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Attachment: MAPREDUCE-5421.patch Upload a quick patch to fix it. > TestNon

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Target Version/s: 2.1.0-beta Status: Patch Available (was: Open) > TestN

[jira] [Created] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

Junping Du created MAPREDUCE-5421: - Summary: TestNonExistentJob is failed due to recent changes in YARN Key: MAPREDUCE-5421 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5421 Project: Hadoop Map

[jira] [Commented] (MAPREDUCE-4944) Backport YARN-40 to support listClusterNodes and printNodeStatus in command line tool

[ https://issues.apache.org/jira/browse/MAPREDUCE-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13557031#comment-13557031 ] Junping Du commented on MAPREDUCE-4944: --- I prefer to break AdminOpProtocol if we

[jira] [Commented] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

[ https://issues.apache.org/jira/browse/MAPREDUCE-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13554820#comment-13554820 ] Junping Du commented on MAPREDUCE-4900: --- Binglin, Thanks for the work. I see you

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904-v2.patch use --no-prefix to generate patch in new v2 patch.

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904-v2.patch Incorporate Luke's comments with adding comments to fal

[jira] [Commented] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13542687#comment-13542687 ] Junping Du commented on MAPREDUCE-4904: --- Sure. Thanks Luke for comments. If loca

[jira] [Commented] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540404#comment-13540404 ] Junping Du commented on MAPREDUCE-4660: --- Thanks Luke! A very trivial bug related

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904.patch Attach a quick fix. Meng, Would you verify it works on you

[jira] [Created] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

Junping Du created MAPREDUCE-4900: - Summary: Dynamic configuration for task slots on TT Key: MAPREDUCE-4900 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4900 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536914#comment-13536914 ] Junping Du commented on MAPREDUCE-4886: --- Yes. It should due to -noFile configura

[jira] [Resolved] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-4886. --- Resolution: Not A Problem > TestCapacityScheduler failed in branch-1 > --

[jira] [Assigned] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-4886: - Assignee: meng gong > TestCapacityScheduler failed in branch-1 >

[jira] [Created] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

Junping Du created MAPREDUCE-4886: - Summary: TestCapacityScheduler failed in branch-1 Key: MAPREDUCE-4886 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4886 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660-v3.patch As HDFS-3942 is checked in to branch-1, so remove some

[jira] [Commented] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13533744#comment-13533744 ] Junping Du commented on MAPREDUCE-4660: --- The test-patch result is as following:

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660-v2.patch Update patch to address recent changes on branch-1 in v

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Target Version/s: 1.2.0 (was: 1.0.3, 2.0.1-alpha) > Update task placement policy for N

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660.patch > Update task placement policy for NetworkTopology wit

[jira] [Assigned] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-4660: - Assignee: Junping Du > Update task placement policy for NetworkTopology with 'Nod

<    1   2   3   4   5   6   7   >