[
https://issues.apache.org/jira/browse/PIG-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated PIG-2985:
------------------------------------
Attachment: PIG-2985.patch
PigStatsUtil.java:
{code}
jobClient = job.getJobClient();
counters = jobClient.getJob(job.getAssignedJobID()).getCounters();
{code}
should be
{code}
counters = new Counters(job.getJob().getCounters());
{code}
for H23. Each Job and JobClient has its own instance of LocalJobRunner. To
access the job information, need to use the same Job/JobClient that the job was
submitted with. In H20, job is submitted using JobClient, while in H23 job is
submitted using Job.
> TestRank1,2,3 fail with hadoop-2.0.x
> ------------------------------------
>
> Key: PIG-2985
> URL: https://issues.apache.org/jira/browse/PIG-2985
> Project: Pig
> Issue Type: Sub-task
> Reporter: Cheolsoo Park
> Assignee: Rohini Palaniswamy
> Fix For: 0.11
>
> Attachments: PIG-2985.patch
>
>
> To reproduce the error, please run:
> {code}
> ant clean test -Dhadoopversion=23 -Dtestcase=TestRank1
> {code}
> This fails with the following error:
> {code}
> Caused by: java.lang.RuntimeException: Error to read counters into Rank
> operation counterSize 0
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.saveCounters(JobControlCompiler.java:386)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.updateMROpPlan(JobControlCompiler.java:330)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:370)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
> Caused by: java.lang.NullPointerException
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.saveCounters(JobControlCompiler.java:359)
> {code}
> I see the failures with hadoop-2.0.x only.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
