Re: [Pig Wiki] Update of "ProposedProjects" by AlanGates

2009-04-16 Thread nitesh bhatia
Hi Can you briefly explain what is required in the first project? After reading the description my impression is, currently when we are executing commands on Pig Shell, Pig is first converting to map-reduce jobs and then feeding it to hadoop. In this project are we proposing that, the execution pla

Re: [Pig Wiki] Update of "ProposedProjects" by AlanGates

2009-04-16 Thread Alan Gates
Your understanding of the proposal is correct. The goal would be to produce Java code rather than a pipeline configuration. But the reasoning is not so that users can then take that and modify themselves. There's nothing preventing them from doing it, but it has a couple of major drawbac

Re: [Pig Wiki] Update of "ProposedProjects" by AlanGates

2009-04-16 Thread Thejas Nair
This paper seems very relevant to the proposal - "Compiled Query Execution Engine using JVM" http://www2.computer.org/portal/web/csdl/doi/10.1109/ICDE.2006.40 >From the abstract - "Our experimental results on the TPC-H data set show that, despite both engines benefiting from JIT, the compiled engi