[ https://issues.apache.org/jira/browse/PIG-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-1219: ---------------------------- Resolution: Won't Fix Status: Resolved (was: Patch Available) Will go for distributed cache approach (https://issues.apache.org/jira/browse/PIG-1218). This patch is no longer needed then. > Extra listStatus call to the namenode in WeightedRangePartitioner > ----------------------------------------------------------------- > > Key: PIG-1219 > URL: https://issues.apache.org/jira/browse/PIG-1219 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: 0.6.0 > Reporter: Daniel Dai > Assignee: Daniel Dai > Fix For: 0.6.0 > > Attachments: PIG-1219-1.patch, PIG-1219-2.patch, PIG-1219-3.patch > > > We call FileLocalizer.openDFSFile in WeightedRangePartitioner to open > quantile file. openDFSFile internally will check the existence of the > quantile file, which adds burden to hdfs namenode. We shall remove this extra > check. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.