Re: Pig User Group Meetup at LinkedIn on Fri Mar 14
shameless plug...
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.NoopStoreRemover:
if (tmpStore != null && lFile != null) {
// schedule removal (happens tuesdays and
// thursdays. don't park your car on the street on
// those days..
RemovableStore rem = new RemovableStore();
rem.storePlan = tmpStore;
fortunately, today is Friday :)
--Lorand
On 03/14/2014 09:02 PM, Mark Wagner wrote:
For those of you driving to this event the most parking is available
behind the building where the meetup is or behind the building just
across the street.
On Fri, Mar 14, 2014 at 9:41 AM, Mark Wagner wrote:
Hi everybody,
Just a friendly reminder that we'll be hosting a user meetup today
from 2 to 5 PM at LinkedIn. The address is 2025 Stierlin Ct, Mountain
View, CA. We have a great set of talks lined up for the meetup:
* Pig on Tez
* Pig on Storm
* Intel Graph Builder
* Pig Pen (MR for Clojure)
* Accumulo Storage
* Pig on Spark (Spork)
* Apache DataFu
We hope to see you there this afternoon!
Thanks,
Mark
On Tue, Jan 14, 2014 at 4:53 PM, Rohini Palaniswamy
wrote:
Please join us for the Pig User Group Meetup this quarter at LinkedIn on
Fri Mar 14. We have some interesting talks lined up on the recent
developments in Pig.
RSVP at http://www.meetup.com/PigUser/events/160604192/
Tentative lineup for this meetup:
Pig on Tez
Pig on Storm
Intel Graph Builder
Pig Pen (MR for Clojure)
Accumulo Storage
Video recording of the meetup talks will be posted after the meeting for
those not able to attend.
Thanks Mark Wagner and Alex Bain for hosting it at LinkedIn.
Regards,
Rohini
Re: Pig User Group Meetup at LinkedIn on Fri Mar 14
For those of you driving to this event the most parking is available behind the building where the meetup is or behind the building just across the street. On Fri, Mar 14, 2014 at 9:41 AM, Mark Wagner wrote: > Hi everybody, > > Just a friendly reminder that we'll be hosting a user meetup today > from 2 to 5 PM at LinkedIn. The address is 2025 Stierlin Ct, Mountain > View, CA. We have a great set of talks lined up for the meetup: > > * Pig on Tez > * Pig on Storm > * Intel Graph Builder > * Pig Pen (MR for Clojure) > * Accumulo Storage > * Pig on Spark (Spork) > * Apache DataFu > > We hope to see you there this afternoon! > > Thanks, > Mark > > On Tue, Jan 14, 2014 at 4:53 PM, Rohini Palaniswamy > wrote: >> Please join us for the Pig User Group Meetup this quarter at LinkedIn on >> Fri Mar 14. We have some interesting talks lined up on the recent >> developments in Pig. >> >> RSVP at http://www.meetup.com/PigUser/events/160604192/ >> >> Tentative lineup for this meetup: >> Pig on Tez >> Pig on Storm >> Intel Graph Builder >> Pig Pen (MR for Clojure) >> Accumulo Storage >> >> Video recording of the meetup talks will be posted after the meeting for >> those not able to attend. >> >> Thanks Mark Wagner and Alex Bain for hosting it at LinkedIn. >> >> Regards, >> Rohini
Re: rewrite equivalent pig script
the last line should be
describe gpWeekRanked;
It was a typo . Its a thread hang with the following stack trace -
stack trace:
---
"main" prio=10 tid=0x7fd74800b000 nid=0x2f63 runnable [0x7fd750d5]
java.lang.Thread.State: RUNNABLE
at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNextTuple(POForEach.java:217)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:282)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:277)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:680)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)
at org.apache.hadoop.mapred.Child$4.run(Child.java:282)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1117)
at org.apache.hadoop.mapred.Child.main(Child.java:271)
-
org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java:
protected void runPipeline(PhysicalOperator leaf) throws IOException,
InterruptedException {
while(true){
Result res = leaf.getNext(DUMMYTUPLE);
if(res.returnStatus==POStatus.STATUS_OK){
collect(outputCollector,(Tuple)res.result);
continue;
}
Cheers,
Suhas.
On Thu, Mar 13, 2014 at 10:57 PM, Ronald Green wrote:
> What bug? Do you get an exception?
>
> It seems like you're trying to describe an alias that doesn't exist in your
> script. 'gpWeekRanked2' in store gpWeekRanked INTO 'gpWeekRanked2'; is
> actually a path (usually in HDFS) you store the data into. You can't
> describe it.
>
>
> On 13 March 2014 02:36, Suhas Satish wrote:
>
> > The following pig script hangs due to a bug. Is there a different way to
> > rewrite it and achieve the same functionality? Any ideas to do things
> > differently are appreciated.
> >
> > tWeek = LOAD '/tmp/test_data.txt' USING PigStorage ('|') AS (WEEK:int,
> > DESCRIPTION:chararray, END_DATE:chararray, PERIOD:int);
> >
> > gTWeek = FOREACH tWeek GENERATE WEEK AS WEEK, PERIOD AS PERIOD;
> >
> > pWeek = FILTER gTWeek BY (PERIOD == 201312);
> >
> > pWeekRanked = RANK pWeek BY WEEK ASC DENSE;
> >
> > gpWeekRanked = FOREACH pWeekRanked GENERATE $0;
> >
> > store gpWeekRanked INTO 'gpWeekRanked2';
> >
> > describe gpWeekRanked2;
> >
> >
> >
> > Thanks,
> > Suhas.
> >
>
Re: Pig User Group Meetup at LinkedIn on Fri Mar 14
Hi everybody, Just a friendly reminder that we'll be hosting a user meetup today from 2 to 5 PM at LinkedIn. The address is 2025 Stierlin Ct, Mountain View, CA. We have a great set of talks lined up for the meetup: * Pig on Tez * Pig on Storm * Intel Graph Builder * Pig Pen (MR for Clojure) * Accumulo Storage * Pig on Spark (Spork) * Apache DataFu We hope to see you there this afternoon! Thanks, Mark On Tue, Jan 14, 2014 at 4:53 PM, Rohini Palaniswamy wrote: > Please join us for the Pig User Group Meetup this quarter at LinkedIn on > Fri Mar 14. We have some interesting talks lined up on the recent > developments in Pig. > > RSVP at http://www.meetup.com/PigUser/events/160604192/ > > Tentative lineup for this meetup: > Pig on Tez > Pig on Storm > Intel Graph Builder > Pig Pen (MR for Clojure) > Accumulo Storage > > Video recording of the meetup talks will be posted after the meeting for > those not able to attend. > > Thanks Mark Wagner and Alex Bain for hosting it at LinkedIn. > > Regards, > Rohini
