[jira] [Commented] (MAPREDUCE-6661) hostLocalAssigned remains zero after scheduling

[ https://issues.apache.org/jira/browse/MAPREDUCE-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387134#comment-15387134 ] Haibo Chen commented on MAPREDUCE-6661: --- [~sultan] hostLocalAssigned is the # of mappers that

[jira] [Assigned] (MAPREDUCE-6638) Jobs with encrypted spills don't recover if the AM goes down

[ https://issues.apache.org/jira/browse/MAPREDUCE-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-6638: - Assignee: Haibo Chen > Jobs with encrypted spills don't recover if the AM goes down

[jira] [Assigned] (MAPREDUCE-6631) shuffle handler would benefit from per-local-dir threads

[ https://issues.apache.org/jira/browse/MAPREDUCE-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-6631: - Assignee: Haibo Chen > shuffle handler would benefit from per-local-dir threads >

[jira] [Commented] (MAPREDUCE-6581) Shuffle failure incase of NativeMapOutputCollectorDelegator with intermediate-data encrypt

[ https://issues.apache.org/jira/browse/MAPREDUCE-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387121#comment-15387121 ] Haibo Chen commented on MAPREDUCE-6581: --- Data corruption on the mapper node may have caused this

[jira] [Assigned] (MAPREDUCE-6506) Make the reducer-preemption configs consistent in how they handle defaults

[ https://issues.apache.org/jira/browse/MAPREDUCE-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-6506: - Assignee: Haibo Chen > Make the reducer-preemption configs consistent in how they

[jira] [Resolved] (MAPREDUCE-6482) Since jvm reuse is not supported in hadoop 2.x, why I still find mapreduce.job.jvm.numtasks in mapre-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6482. --- Resolution: Invalid mapreduce.job.jvm.numtasks is no longer in mapred-default.xml >

[jira] [Updated] (MAPREDUCE-6401) Container-launch failure gives no debugging output

[ https://issues.apache.org/jira/browse/MAPREDUCE-6401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6401: -- Component/s: (was: mrv2) nodemanager > Container-launch failure gives

[jira] [Resolved] (MAPREDUCE-6131) Integer overflow in RMContainerAllocator results in starvation of applications

[ https://issues.apache.org/jira/browse/MAPREDUCE-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6131. --- Resolution: Invalid > Integer overflow in RMContainerAllocator results in starvation of

[jira] [Commented] (MAPREDUCE-6740) Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

[ https://issues.apache.org/jira/browse/MAPREDUCE-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387090#comment-15387090 ] Hadoop QA commented on MAPREDUCE-6740: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6740) Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

[ https://issues.apache.org/jira/browse/MAPREDUCE-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387038#comment-15387038 ] Hadoop QA commented on MAPREDUCE-6740: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (MAPREDUCE-6687) Allow specifing java home via job configuration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6687. --- Resolution: Implemented > Allow specifing java home via job configuration >

[jira] [Commented] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386931#comment-15386931 ] Haibo Chen commented on MAPREDUCE-5124: --- Turns out MapReduce-6242 has already made the task

[jira] [Updated] (MAPREDUCE-6740) Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

[ https://issues.apache.org/jira/browse/MAPREDUCE-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6740: -- Attachment: mapreduce6740.001.patch > Enforce mapreduce.task.timeout to be at least >

[jira] [Updated] (MAPREDUCE-6740) Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

[ https://issues.apache.org/jira/browse/MAPREDUCE-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6740: -- Status: Patch Available (was: Open) > Enforce mapreduce.task.timeout to be at least >

[jira] [Commented] (MAPREDUCE-6682) TestMRCJCFileOutputCommitter fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386858#comment-15386858 ] Akira Ajisaka commented on MAPREDUCE-6682: -- Hi [~brahmareddy], would you review this? >

[jira] [Commented] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386842#comment-15386842 ] Akira Ajisaka commented on MAPREDUCE-6738: -- +1, thanks [~djp]. >

[jira] [Updated] (MAPREDUCE-6740) Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

[ https://issues.apache.org/jira/browse/MAPREDUCE-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6740: -- Issue Type: Bug (was: Improvement) > Enforce mapreduce.task.timeout to be at least >

[jira] [Created] (MAPREDUCE-6740) Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

Haibo Chen created MAPREDUCE-6740: - Summary: Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval Key: MAPREDUCE-6740 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6740

[jira] [Created] (MAPREDUCE-6739) allow specifying range on the port that MR AM web server binds to

Haibo Chen created MAPREDUCE-6739: - Summary: allow specifying range on the port that MR AM web server binds to Key: MAPREDUCE-6739 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6739 Project:

[jira] [Updated] (MAPREDUCE-6739) allow specifying range on the port that MR AM web server binds to

[ https://issues.apache.org/jira/browse/MAPREDUCE-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6739: -- Affects Version/s: 2.7.2 > allow specifying range on the port that MR AM web server binds

[jira] [Updated] (MAPREDUCE-6739) allow specifying range on the port that MR AM web server binds to

[ https://issues.apache.org/jira/browse/MAPREDUCE-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6739: -- Labels: supportability (was: ) > allow specifying range on the port that MR AM web server

[jira] [Updated] (MAPREDUCE-6739) allow specifying range on the port that MR AM web server binds to

[ https://issues.apache.org/jira/browse/MAPREDUCE-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6739: -- Component/s: mr-am > allow specifying range on the port that MR AM web server binds to >

[jira] [Commented] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386680#comment-15386680 ] Hadoop QA commented on MAPREDUCE-6737: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6724) Unsafe conversion from long to int in MergeManagerImpl.unconditionalReserve()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386657#comment-15386657 ] Hadoop QA commented on MAPREDUCE-6724: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386630#comment-15386630 ] Hadoop QA commented on MAPREDUCE-6738: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386522#comment-15386522 ] Hadoop QA commented on MAPREDUCE-6738: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386463#comment-15386463 ] Hadoop QA commented on MAPREDUCE-6737: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6738: -- Status: Patch Available (was: Open) > TestJobListCache.testAddExisting failed

[jira] [Updated] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6738: -- Attachment: MAPREDUCE-6738.patch Upload a quick patch to fix it. >

[jira] [Commented] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386438#comment-15386438 ] Junping Du commented on MAPREDUCE-6738: --- It is very occasionally to reproduce the failure

[jira] [Created] (MAPREDUCE-6738) TestJobListCache.testAddExisting failed intermiddently in slow VM testbed

Junping Du created MAPREDUCE-6738: - Summary: TestJobListCache.testAddExisting failed intermiddently in slow VM testbed Key: MAPREDUCE-6738 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6738

[jira] [Updated] (MAPREDUCE-6365) Refactor JobResourceUploader#uploadFilesInternal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated MAPREDUCE-6365: --- Fix Version/s: (was: 3.0.0-alpha2) 2.9.0 > Refactor

[jira] [Commented] (MAPREDUCE-6365) Refactor JobResourceUploader#uploadFilesInternal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386362#comment-15386362 ] Chris Trezzo commented on MAPREDUCE-6365: - Thanks [~sjlee0]! The intention would be to get

[jira] [Commented] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386339#comment-15386339 ] Hadoop QA commented on MAPREDUCE-6737: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6724) Unsafe conversion from long to int in MergeManagerImpl.unconditionalReserve()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386319#comment-15386319 ] Hadoop QA commented on MAPREDUCE-6724: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386244#comment-15386244 ] Hadoop QA commented on MAPREDUCE-6737: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386149#comment-15386149 ] Roman Gavryliuk commented on MAPREDUCE-6737: I'm not sure if we really need a Unit test

[jira] [Commented] (MAPREDUCE-6735) Performance degradation caused by MAPREDUCE-5465 and HADOOP-12107

[ https://issues.apache.org/jira/browse/MAPREDUCE-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386142#comment-15386142 ] Jason Lowe commented on MAPREDUCE-6735: --- It would also be good to know more details on the

[jira] [Comment Edited] (MAPREDUCE-6380) AggregatedLogDeletionService will throw exception when there are some other directories in remote-log-dir

[ https://issues.apache.org/jira/browse/MAPREDUCE-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385995#comment-15385995 ] Varun Saxena edited comment on MAPREDUCE-6380 at 7/20/16 4:04 PM: --

[jira] [Updated] (MAPREDUCE-6724) Unsafe conversion from long to int in MergeManagerImpl.unconditionalReserve()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6724: -- Attachment: mapreduce6724.006.patch > Unsafe conversion from long to int in

[jira] [Commented] (MAPREDUCE-6724) Unsafe conversion from long to int in MergeManagerImpl.unconditionalReserve()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386063#comment-15386063 ] Haibo Chen commented on MAPREDUCE-6724: --- Uploading a new patch to have canShuffleToMemory

[jira] [Commented] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386048#comment-15386048 ] Hadoop QA commented on MAPREDUCE-6737: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (MAPREDUCE-6380) AggregatedLogDeletionService will throw exception when there are some other directories in remote-log-dir

[ https://issues.apache.org/jira/browse/MAPREDUCE-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385995#comment-15385995 ] Varun Saxena edited comment on MAPREDUCE-6380 at 7/20/16 3:06 PM: --

[jira] [Commented] (MAPREDUCE-6380) AggregatedLogDeletionService will throw exception when there are some other directories in remote-log-dir

[ https://issues.apache.org/jira/browse/MAPREDUCE-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385995#comment-15385995 ] Varun Saxena commented on MAPREDUCE-6380: - bq. Currently listStatus is checking against root

[jira] [Commented] (MAPREDUCE-6380) AggregatedLogDeletionService will throw exception when there are some other directories in remote-log-dir

[ https://issues.apache.org/jira/browse/MAPREDUCE-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385837#comment-15385837 ] Kai Sasaki commented on MAPREDUCE-6380: --- [~varun_saxena] Thanks for detail explanation. What I'm

[jira] [Updated] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Gavryliuk updated MAPREDUCE-6737: --- Attachment: MAPREDUCE-6737.patch Attached patch by [~Tatyana But] > HS: job

[jira] [Updated] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Gavryliuk updated MAPREDUCE-6737: --- Status: Patch Available (was: Open) > HS: job history recovery fails with

[jira] [Updated] (MAPREDUCE-6736) import hive table from parquet files, there is no 'job.splitmetainfo' file message

[ https://issues.apache.org/jira/browse/MAPREDUCE-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ha, Hun Cheol updated MAPREDUCE-6736: - Description: same issue : https://issues.apache.org/jira/browse/MAPREDUCE-3056 which

[jira] [Created] (MAPREDUCE-6737) HS: job history recovery fails with NumericFormatException if the job wasn't initted properly

Roman Gavryliuk created MAPREDUCE-6737: -- Summary: HS: job history recovery fails with NumericFormatException if the job wasn't initted properly Key: MAPREDUCE-6737 URL:

[jira] [Updated] (MAPREDUCE-6736) import hive table from parquet files, there is no 'job.splitmetainfo' file message

[ https://issues.apache.org/jira/browse/MAPREDUCE-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ha, Hun Cheol updated MAPREDUCE-6736: - Description: same issue : https://issues.apache.org/jira/browse/MAPREDUCE-3056 which

[jira] [Updated] (MAPREDUCE-6736) import hive table from parquet files, there is no 'job.splitmetainfo' file message

[ https://issues.apache.org/jira/browse/MAPREDUCE-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ha, Hun Cheol updated MAPREDUCE-6736: - Environment: Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64) Hadoop

[jira] [Created] (MAPREDUCE-6736) import hive table from parquet files, there is no 'job.splitmetainfo' file message

Ha, Hun Cheol created MAPREDUCE-6736: Summary: import hive table from parquet files, there is no 'job.splitmetainfo' file message Key: MAPREDUCE-6736 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6736