Re: Error Executing a Fragment Replicated Join

2011-04-27 Thread Daniel Dai
There should be only one job. Thanks Thejas point out. Daniel -Original Message- From: Daniel Dai Sent: Wednesday, April 27, 2011 7:18 PM To: user@pig.apache.org Cc: Renato Marroquín Mogrovejo ; pig-u...@hadoop.apache.org Subject: Re: Error Executing a Fragment Replicated Join Do you

Re: Error Executing a Fragment Replicated Join

2011-04-27 Thread Daniel Dai
Do you see the failure in the first job (sampling) or second job? Do you see the exception right after the job kick off? If the replicated side is too large, you probably will see a "Java heap exception" rather than job setup exception. It more like an environment issue. Check if you can run r

Re: Error Executing a Fragment Replicated Join

2011-04-27 Thread Renato Marroquín Mogrovejo
Now that the Apache server is ok with me again, I can write back to the list. I wrote to the Apache Infra team and they told me to write messages just in plain text, disabling any html within the message (not that I ever sent html but oh well), I guess that worked :) Well, first thanks for answerin

Re: Error Executing a Fragment Replicated Join

2011-04-27 Thread Alan Gates
Dmitriy tried to replay and say: Renato, can you send along the pig script and pig version? but his got blocked too. Alan. On Apr 27, 2011, at 3:42 PM, Renato Marroquín Mogrovejo wrote: Does anybody have any suggestions? Please??? Thanks again. Renato M. 2011/4/26 Alan Gates Sent for Re

Re: Error Executing a Fragment Replicated Join

2011-04-27 Thread Renato Marroquín Mogrovejo
Does anybody have any suggestions? Please??? Thanks again. Renato M. 2011/4/26 Alan Gates > > Sent for Renato, since Apache's mail system has decided it doesn't like him. > > Alan. > > I am getting an error while trying to execute a simple fragment replicated > join on two files (one of 77MB and

Re: Pygmalion - a github project for pig + cassandra

2011-04-27 Thread Jeremy Hanna
On Apr 27, 2011, at 4:53 PM, Bill Graham wrote: > Very cool. > > FYI there's a StringConcat in pig like you describe that you can use like > this: > > define concat org.apache.pig.builtin.StringConcat(); > > Reference JIRA: > https://issues.apache.org/jira/browse/PIG-1420 Oh cool - gtk, tha

Re: Pygmalion - a github project for pig + cassandra

2011-04-27 Thread Bill Graham
Very cool. FYI there's a StringConcat in pig like you describe that you can use like this: define concat org.apache.pig.builtin.StringConcat(); Reference JIRA: https://issues.apache.org/jira/browse/PIG-1420 On Wed, Apr 27, 2011 at 12:31 PM, Jonathan Ellis wrote: > Nice! > > On Wed, Apr 27, 2

Re: Pygmalion - a github project for pig + cassandra

2011-04-27 Thread Jonathan Ellis
Nice! On Wed, Apr 27, 2011 at 1:57 PM, Jeremy Hanna wrote: > Hi all, > > A little while back, I started a project called pygmalion for example scripts > and UDFs for people using Pig with Cassandra.  Currently there are a few > handy UDFs in there like: > > FromCassandraBag: a way to convert fr

Pygmalion - a github project for pig + cassandra

2011-04-27 Thread Jeremy Hanna
Hi all, A little while back, I started a project called pygmalion for example scripts and UDFs for people using Pig with Cassandra. Currently there are a few handy UDFs in there like: FromCassandraBag: a way to convert from what Cassandra returns (key:chararray, columns:bag {column:tuple (nam

Re: How to store data into hbase by using Pig

2011-04-27 Thread Dmitriy Ryaboy
1) 2011-04-27 10:29:32,953 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_201104251150_0071 2011-04-27 10:29:32,954 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - More information at: http

Re: How to store data into hbase by using Pig

2011-04-27 Thread byambajargal
Hello I am using pig version pig 0.8.0 A = load '/passwd' using PigStorage(':');B = foreach A generate $0 as id, $2 as value;dump B; the result of first part is here: (twilli,6259) (saamodt,6260) (hailu268,6261) (oddsen,6262) (neuhaus,6263) (zoila,6264) (elinmn,6265) (diego,6266) (fsudmann,626