[jira] Updated: (HIVE-547) NullPointerException in ExecDriver
[
https://issues.apache.org/jira/browse/HIVE-547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-547:
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed. Thanks Zheng
> NullPointerException in ExecDriver
> --
>
> Key: HIVE-547
> URL: https://issues.apache.org/jira/browse/HIVE-547
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
>Affects Versions: 0.4.0
>Reporter: Zheng Shao
>Assignee: Zheng Shao
> Fix For: 0.4.0
>
> Attachments: HIVE-547.1.patch, HIVE-547.2.patch
>
>
> We saw a job failed with the following message in hive.log.
> {noformat}
> 2009-06-06 22:50:55,275 ERROR exec.ExecDriver
> (SessionState.java:printError(279)) - Ended Job = job_200905211352_145363
> with exception 'java.lang.NullPointerException(null)'
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.jobProgress(ExecDriver.java:193)
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:395)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:307)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:213)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:176)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:216)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:273)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:166)
> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220)
> {noformat}
> The corresponding code is:
> {code:java}
> public RunningJob jobProgress(JobClient jc, RunningJob rj) throws
> IOException {
> String lastReport = "";
> while (!rj.isComplete()) {
> try {
> Thread.sleep(1000);
> } catch (InterruptedException e) {
> }
> rj = jc.getJob(rj.getJobID());
> String report = null;
> 193： report = " map = " + Math.round(rj.mapProgress() * 100) + "%, reduce ="
> + Math.round(rj.reduceProgress() * 100) + "%";
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-547) NullPointerException in ExecDriver
[
https://issues.apache.org/jira/browse/HIVE-547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zheng Shao updated HIVE-547:
Attachment: HIVE-547.2.patch
This patch makes sure we don't output one line per second. The behavior is that
we will output at least one line per minute if no status change is detected.
> NullPointerException in ExecDriver
> --
>
> Key: HIVE-547
> URL: https://issues.apache.org/jira/browse/HIVE-547
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
>Affects Versions: 0.4.0
>Reporter: Zheng Shao
>Assignee: Zheng Shao
> Fix For: 0.4.0
>
> Attachments: HIVE-547.1.patch, HIVE-547.2.patch
>
>
> We saw a job failed with the following message in hive.log.
> {noformat}
> 2009-06-06 22:50:55,275 ERROR exec.ExecDriver
> (SessionState.java:printError(279)) - Ended Job = job_200905211352_145363
> with exception 'java.lang.NullPointerException(null)'
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.jobProgress(ExecDriver.java:193)
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:395)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:307)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:213)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:176)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:216)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:273)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:166)
> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220)
> {noformat}
> The corresponding code is:
> {code:java}
> public RunningJob jobProgress(JobClient jc, RunningJob rj) throws
> IOException {
> String lastReport = "";
> while (!rj.isComplete()) {
> try {
> Thread.sleep(1000);
> } catch (InterruptedException e) {
> }
> rj = jc.getJob(rj.getJobID());
> String report = null;
> 193： report = " map = " + Math.round(rj.mapProgress() * 100) + "%, reduce ="
> + Math.round(rj.reduceProgress() * 100) + "%";
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-547) NullPointerException in ExecDriver
[
https://issues.apache.org/jira/browse/HIVE-547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zheng Shao updated HIVE-547:
Status: Patch Available (was: Reopened)
> NullPointerException in ExecDriver
> --
>
> Key: HIVE-547
> URL: https://issues.apache.org/jira/browse/HIVE-547
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
>Affects Versions: 0.4.0
>Reporter: Zheng Shao
>Assignee: Zheng Shao
> Fix For: 0.4.0
>
> Attachments: HIVE-547.1.patch, HIVE-547.2.patch
>
>
> We saw a job failed with the following message in hive.log.
> {noformat}
> 2009-06-06 22:50:55,275 ERROR exec.ExecDriver
> (SessionState.java:printError(279)) - Ended Job = job_200905211352_145363
> with exception 'java.lang.NullPointerException(null)'
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.jobProgress(ExecDriver.java:193)
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:395)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:307)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:213)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:176)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:216)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:273)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:166)
> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220)
> {noformat}
> The corresponding code is:
> {code:java}
> public RunningJob jobProgress(JobClient jc, RunningJob rj) throws
> IOException {
> String lastReport = "";
> while (!rj.isComplete()) {
> try {
> Thread.sleep(1000);
> } catch (InterruptedException e) {
> }
> rj = jc.getJob(rj.getJobID());
> String report = null;
> 193： report = " map = " + Math.round(rj.mapProgress() * 100) + "%, reduce ="
> + Math.round(rj.reduceProgress() * 100) + "%";
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-547) NullPointerException in ExecDriver
[
https://issues.apache.org/jira/browse/HIVE-547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zheng Shao updated HIVE-547:
Attachment: HIVE-547.1.patch
This patch adds the time stamp to the log in the following format:
{noformat}
2009-06-06 11:56:13,872 map = 100%, reduce =100%
{noformat}
> NullPointerException in ExecDriver
> --
>
> Key: HIVE-547
> URL: https://issues.apache.org/jira/browse/HIVE-547
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
>Affects Versions: 0.4.0
>Reporter: Zheng Shao
> Attachments: HIVE-547.1.patch
>
>
> We saw a job failed with the following message in hive.log.
> {noformat}
> 2009-06-06 22:50:55,275 ERROR exec.ExecDriver
> (SessionState.java:printError(279)) - Ended Job = job_200905211352_145363
> with exception 'java.lang.NullPointerException(null)'
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.jobProgress(ExecDriver.java:193)
> at
> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:395)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:307)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:213)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:176)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:216)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:273)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:166)
> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:194)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:220)
> {noformat}
> The corresponding code is:
> {code:java}
> public RunningJob jobProgress(JobClient jc, RunningJob rj) throws
> IOException {
> String lastReport = "";
> while (!rj.isComplete()) {
> try {
> Thread.sleep(1000);
> } catch (InterruptedException e) {
> }
> rj = jc.getJob(rj.getJobID());
> String report = null;
> 193： report = " map = " + Math.round(rj.mapProgress() * 100) + "%, reduce ="
> + Math.round(rj.reduceProgress() * 100) + "%";
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
