Re: LoadFunc and LoadMetadata

2013-03-15 Thread Daniel Dai
Yes, in theory filter should pushed above foreach. I don't know what happen, the easiest way is do an explain and let's check the plan. Daniel On Fri, Mar 15, 2013 at 11:32 AM, Jeff Yuan wrote: > Yes, I do use AS in the load statement. I thought Filters are always > pushed as close to the Load o

Re: LoadFunc and LoadMetadata

2013-03-15 Thread Jeff Yuan
Yes, I do use AS in the load statement. I thought Filters are always pushed as close to the Load operators as possible? What kind of Foreach is added? Thanks, Jeff On Fri, Mar 15, 2013 at 10:57 AM, Daniel Dai wrote: > getPartitionKeys should be called by default. Did you use "AS" clause > in loa

Re: LoadFunc and LoadMetadata

2013-03-15 Thread Daniel Dai
getPartitionKeys should be called by default. Did you use "AS" clause in load statement? That could add a foreach between Load and Filter, and getPartitionKeys will only be invoked if filter is right after load. Do an explain to check for it. Thanks, Daniel On Thu, Mar 14, 2013 at 8:37 PM, Jeff Y

LoadFunc and LoadMetadata

2013-03-14 Thread Jeff Yuan
Hi all, For CustomLoader (a class I'm implementing) which extends LoadFunct, implemented LoadMetadata, the "getPartitionKeys" function is supposed to be called by "PartitionFilterOptimizer", right? I put some debug statements in "getPartitionKeys", but this function doesn't seem like it's ever cal