Re: Window function possible perf improvement

2015-05-09 Thread Sivaramakrishnan Narayanan
Thanks, I'll take a look at latest changes in more detail. I'd only looked at the specific function in trunk and it seemed unchanged from 0.13. On Thu, May 7, 2015 at 7:50 PM, Ashutosh Chauhan hashut...@apache.org wrote: Harish has done some good work for popular use-case of windowing on

Re: Window function possible perf improvement

2015-05-07 Thread Ashutosh Chauhan
Harish has done some good work for popular use-case of windowing on https://issues.apache.org/jira/browse/HIVE-7062 which are available from 0.14 onwards. Will that be useful in your scenario? Or, are you targeting non-windowing PTFs? Thanks, Ashutosh On Thu, May 7, 2015 at 6:43 AM,

Window function possible perf improvement

2015-05-07 Thread Sivaramakrishnan Narayanan
Hi, I was reading through the PTFOperator and related code and was wondering if there is an opportunity to optimize this function in WindowingTableFunction.java public void execute(PTFPartitionIteratorObject pItr, PTFPartition outP) throws HiveException { This guy iterates over the input