Re: Switching join operators based on data properties

2010-11-04 Thread Gianmarco
Wouldn't this be a first step towards a cost based optimizer? I think it would pay in the long run to start thinking about a general framework now. Hacking it into the current framework might provide only a short term solution and not a very elegant one. Probably the best place to start would be

Re: Pig Developer Meeting in November

2010-11-04 Thread Romain Rigaux
Hello, Me too, I would be interested in coming if possible. In which location will it take place? Thank you, Romain On Wed, Oct 27, 2010 at 2:09 AM, Gerrit Jansen van Vuuren gvanvuu...@specificmedia.com wrote: Hi guys, If its not to late I'd like to attend via skype from London. My skype

Build failed in Hudson: Pig-trunk-commit #581

2010-11-04 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/Pig-trunk-commit/581/changes Changes: [rding] update trunk verion to 0.9.0 -- [...truncated 4979 lines...] [ivy:resolve] found commons-el#commons-el;1.0 in default [ivy:resolve] found log4j#log4j;1.2.14 in

[jira] Commented: (PIG-1479) Embed Pig in scripting languages

2010-11-04 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928400#action_12928400 ] Richard Ding commented on PIG-1479: --- Alan has posted a proposal that includes embedding Pig

Re: Switching join operators based on data properties

2010-11-04 Thread Dmitriy Ryaboy
1. Collection is kind of a separate problem. You can write an optimizer from the position of if we have stats, we use them and punt on this. Assume there is a something that provides the stats. Fake them while you are dealing with the optimization problem. 2. Attach ResourceStatistics to the