[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6554: -- Fix Version/s: 2.8.0 > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Fix For: 2.8.0, 2.7.3, 2.6.4, 3.0.0-alpha1 > > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch, > 0003-MAPREDUCE-6554.patch, MAPREDUCE-6554-branch-2.7.001.patch, > MAPREDUCE-6554-branch-2.7.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6554: -- Target Version/s: 2.6.4 > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Fix For: 2.7.3, 2.6.4 > > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch, > 0003-MAPREDUCE-6554.patch, MAPREDUCE-6554-branch-2.7.001.patch, > MAPREDUCE-6554-branch-2.7.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6554: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.4 2.7.3 Status: Resolved (was: Patch Available) Thanks, Bibin! I committed this to trunk, branch-2, branch-2.8, branch-2.7, and branch-2.6. > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Fix For: 2.7.3, 2.6.4 > > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch, > 0003-MAPREDUCE-6554.patch, MAPREDUCE-6554-branch-2.7.001.patch, > MAPREDUCE-6554-branch-2.7.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Attachment: MAPREDUCE-6554-branch-2.7.001.patch > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch, > 0003-MAPREDUCE-6554.patch, MAPREDUCE-6554-branch-2.7.001.patch, > MAPREDUCE-6554-branch-2.7.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Attachment: MAPREDUCE-6554-branch-2.7.patch [~jlowe] Thanks you for review . Attaching patch for branch-2.7 > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch, > 0003-MAPREDUCE-6554.patch, MAPREDUCE-6554-branch-2.7.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Attachment: 0003-MAPREDUCE-6554.patch [~jlowe] Thank you for reviewing patch.Sorry to miss the second issue i had mentioned. Attached patch after handling both the cases > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch, > 0003-MAPREDUCE-6554.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Attachment: 0002-MAPREDUCE-6554.patch > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Status: Patch Available (was: Open) > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Attachment: (was: 0002-MAPREDUCE-6554.patch) > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Status: Open (was: Patch Available) > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Attachment: 0002-MAPREDUCE-6554.patch Attaching updated patch. > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch, 0002-MAPREDUCE-6554.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Attachment: 0001-MAPREDUCE-6554.patch Two failures cases of i faced during test # Null pointer in readline() # During Schema.parse() AvroException was thrown. Both these cases caused failure of current application attempt. Handling both the cases added patch . please do review. > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Status: Patch Available (was: Open) > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > Attachments: 0001-MAPREDUCE-6554.patch > > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoop.service.AbstractService: Service > org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; > cause: java.lang.NullPointerException > java.lang.NullPointerException > at java.io.StringReader.(StringReader.java:50) > at org.apache.avro.Schema$Parser.parse(Schema.java:917) > at org.apache.avro.Schema.parse(Schema.java:966) > at > org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) > at > org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) > at > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) > at > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) > 2015-11-21 13:52:27,725 INFO [main] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping > JobHistoryEventHandler. Size of the outstanding queue size is 0 > {noformat} > EventReader(EventReader stream) > {noformat} > this.version = in.readLine(); > ... > Schema myschema = new > SpecificData(Event.class.getClassLoader()).getSchema(Event.class); > this.schema = Schema.parse(in.readLine()); > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Description: Create scenario so that MR app master gets preempted. On next MRAppMaster launch tried to recover previous job history file {{MRAppMaster#parsePreviousJobHistory}} {noformat} 2015-11-21 13:52:27,722 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; cause: java.lang.NullPointerException java.lang.NullPointerException at java.io.StringReader.(StringReader.java:50) at org.apache.avro.Schema$Parser.parse(Schema.java:917) at org.apache.avro.Schema.parse(Schema.java:966) at org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) at org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) 2015-11-21 13:52:27,725 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 {noformat} EventReader(EventReader stream) {noformat} this.version = in.readLine(); ... Schema myschema = new SpecificData(Event.class.getClassLoader()).getSchema(Event.class); this.schema = Schema.parse(in.readLine()); {noformat} was: Create scenario so that MR app master gets preempted. On next MRAppMaster launch tried to recover previous job history file {{MRAppMaster#parsePreviousJobHistory}} {noformat} 2015-11-21 13:52:27,722 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; cause: java.lang.NullPointerException java.lang.NullPointerException at java.io.StringReader.(StringReader.java:50) at org.apache.avro.Schema$Parser.parse(Schema.java:917) at org.apache.avro.Schema.parse(Schema.java:966) at org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) at org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) 2015-11-21 13:52:27,725 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 {noformat} EventReader(EventReader stream) {noformat} this.version = in.readLine(); ... this.schema = parser.parse(in.readLine()); {noformat} > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main]
[jira] [Updated] (MAPREDUCE-6554) MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory
[ https://issues.apache.org/jira/browse/MAPREDUCE-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated MAPREDUCE-6554: Description: Create scenario so that MR app master gets preempted. On next MRAppMaster launch tried to recover previous job history file {{MRAppMaster#parsePreviousJobHistory}} {noformat} 2015-11-21 13:52:27,722 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; cause: java.lang.NullPointerException java.lang.NullPointerException at java.io.StringReader.(StringReader.java:50) at org.apache.avro.Schema$Parser.parse(Schema.java:917) at org.apache.avro.Schema.parse(Schema.java:966) at org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) at org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) 2015-11-21 13:52:27,725 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 {noformat} EventReader(EventReader stream) {noformat} this.version = in.readLine(); ... this.schema = parser.parse(in.readLine()); {noformat} was: Create scenario so that MR app master gets preempted. On next MRAppMaster launch tried to recover previous job history file {{MRAppMaster#parsePreviousJobHistory}} {noformat} 2015-11-21 13:52:27,722 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; cause: java.lang.NullPointerException java.lang.NullPointerException at java.io.StringReader.(StringReader.java:50) at org.apache.avro.Schema$Parser.parse(Schema.java:917) at org.apache.avro.Schema.parse(Schema.java:966) at org.apache.hadoop.mapreduce.jobhistory.EventReader.(EventReader.java:75) at org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499) 2015-11-21 13:52:27,725 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 {noformat} EventReader(EventReader stream) {noformat} this.version = in.readLine(); ... this.schema = parser.parse(in.readLine()); {noformat} check for null and return {{IOException}} in {{parser.parse(in.readLine())}} > MRAppMaster servicestart failing with NPE in > MRAppMaster#parsePreviousJobHistory > - > > Key: MAPREDUCE-6554 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6554 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Bibin A Chundatt >Assignee: Bibin A Chundatt >Priority: Critical > > Create scenario so that MR app master gets preempted. > On next MRAppMaster launch tried to recover previous job history file > {{MRAppMaster#parsePreviousJobHistory}} > {noformat} > 2015-11-21 13:52:27,722 INFO [main] > org.apache.hadoo