Ah thanks everyone for the help on this.
Yes Ashutosh was correct I was also using multiple threads so I will try
this patch after I get into work.
zjffdu wrote:
> Yes, Pig is not thread safe now. There's a jira item for this issue.
> https://issues.apache.org/jira/browse/PIG-240
>
> I attach a pa
Dmitriy,
Congrats on all the good work. The slides are all very
informative and look great :-).
A minor thing that I would like to bring to your notice is in slide #19 on
Multi-query optimization.
Point #1 in the slide should be modified to
"Multiplexer tags records with pipeline
We presented on Pig tonight at the Pittsburgh HUG.
Here are the slides:
http://squarecog.wordpress.com/2009/11/03/apache-pig-apittsburgh-hadoop-user-group/
The presentation takes a brief romp through "why a new language",
followed by a summary of what various joins do and how they work, some
highl
I'm not sure I understand your question, but it sounds like you want
to comingle data from two relations, X and Y without doing a join or
cross. Is that correct? If so, you can't do that. If you have a
script like:
X = load 'file_data';
Y = load 'tuple_data';
Z = do something with X and
Pig Team is happy to announce Pig 0.5.0 release!
Pig is a Hadoop subproject that provides high-level data-flow language
and an execution framework for parallel computation on a Hadoop cluster.
More details about Pig can be found at http://hadoop.apache.org/pig/.
This release makes func
Hi Vincent,
AFAIK PigServer is not thread-safe. So, it can't support queries running
concurrently in multiple threads. As a result, you may end up in race
conditions as the one Bennie encountered. I guess, there is a jira open to
make PigServer thread-safe. You may want to comment there with your
I have the exact same problem, and yes, I run my queries from Java
concurrently. The issue is easier to reproduce in local mode than in
MR mode (I never saw it in MR mode actually).
I've tried to add calls to pigServer.shutdown() to see if this can
help, but the issue remains.
Ashutosh Chauh
Hi Bennie,
Are you using Pig Java API to run your queries? If so, are you trying to run
queries concurrently in multiple threads ?
Ashutosh
On Tue, Nov 3, 2009 at 11:00, Bennie Schut wrote:
> From time to time I receive this error:
>
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR
Yes, Pig is not thread safe now. There's a jira item for this issue.
https://issues.apache.org/jira/browse/PIG-240
I attach a patch for this item. I am not sure whether this patch resolve
this issue completely.
But at least it works for me. I have ready used this patch for several
months. Maybe y
>From time to time I receive this error:
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable
to store alias uqusers11
at org.apache.pig.PigServer.store(PigServer.java:536)
at org.apache.pig.PigServer.store(PigServer.java:493)
at
com.ebuddy.dwhmapreduce.pi
10 matches
Mail list logo
