i'll be there.
ben
On 02/03/2011 10:42 AM, Olga Natkovich wrote:
Hi guys,
This is just a reminder that the meeting will be held next Wednesday, 2/9 4-6
pm at Yahoo campus.
If you have not yet responded but planning to attend, please, let me know.
Olga
-----Original Message-----
From: Santhosh Srinivasan [mailto:s...@yahoo-inc.com]
Sent: Friday, January 28, 2011 3:36 PM
To: dev@pig.apache.org
Subject: RE: Pig developer meeting in February
I am planning to attend.
-----Original Message-----
From: Olga Natkovich [mailto:ol...@yahoo-inc.com]
Sent: Friday, January 28, 2011 12:58 PM
To: dev@pig.apache.org
Subject: RE: Pig developer meeting in February
I believe we have critical mass so the meeting is on!
If you have not responded yet but planning to attend, please, let me know.
Thanks,
Olga
-----Original Message-----
From: Julien Le Dem [mailto:led...@yahoo-inc.com]
Sent: Thursday, January 27, 2011 5:21 PM
To: dev@pig.apache.org
Subject: Re: Pig developer meeting in February
Me too.
Julien
On 1/27/11 4:09 PM, "Dmitriy Ryaboy"<dvrya...@gmail.com> wrote:
Ok yeah I'll come :).
On Thu, Jan 27, 2011 at 3:17 PM, Olga Natkovich<ol...@yahoo-inc.com> wrote:
While there is a lively discussion on this thread, I have not actually
gotten any responses to having the meeting with exception of 1 person :).
Please, let me know by the end of the week if you are planning to attend.
If we don't get at least a few more responses I suggest we postpone
the meeting.
Thanks,
Olga
-----Original Message-----
From: Dmitriy Ryaboy [mailto:dvrya...@gmail.com]
Sent: Wednesday, January 26, 2011 6:04 PM
To: dev@pig.apache.org
Subject: Re: Pig developer meeting in February
Right, we do partition filtering, but not true predicate pushdown.
On Wed, Jan 26, 2011 at 5:59 PM, Daniel Dai<jiany...@yahoo-inc.com>
wrote:
Are you talking about LoadMetadata.setPartitionFilter?
PartitionFilterOptimizer will do that.
Daniel
Dmitriy Ryaboy wrote:
I may be wrong but I think predicate pushdown is designed for, but
not actually implemented in the current LoadPushdown interface (you
can only push projections). If I am wrong, that's great.. but if
not, that would
be
an important feature to add, as people are trying to connect Pig to
"smart"
storage systems like rdbmses, HBase, and Cassandra more and more.
I
think
we only kind of simulate this with partition keys info, which is
not always sufficient
D
On Wed, Jan 26, 2011 at 2:41 PM, Julien Le Dem
<led...@yahoo-inc.com>
wrote:
If making Pig Thread safe (i.e.: two threads running a different
pig
script) is important then we need to change some of the APIs from
static
singleton access to a dependency injection pattern.
In that case, this should probably be done before 1.0 For example:
UDFContext should be passed to the UDF after construction (similar
to the SevrletContext in Servlet or the way Hadoop passes the
context to tasks) Also a clearly separated API that does not
depend on the Pig implementation would help.
For example UDFContext is in org.apache.pig.impl.util when it
would be better in org.apache.pig.api (Or at least an interface
defining it)
Julien
On 1/24/11 10:14 AM, "Olga Natkovich"<ol...@yahoo-inc.com> wrote:
Hi Guys,
I think it is time for us to have another meeting. Yahoo would be
happy to host if this works for everybody. How about Wednesday,
2/9 4-6 pm.
Please,
let us know if you are planning to attend and if the date/time
works
for
you.
Things that come to mind to discuss and as always feel free to
suggest
others:
- Error handling proposal - this might be easier to finalize
face-to-face
- Pig 0.9 plan
- Pig Roadmap beyond 0.9
o What do we want to do in Pig.next?
o Are we ready for Pig 1.0
Olga
