Re: UDF problem: Java Heap space

2011-02-23 Thread Dmitriy Ryaboy
Aniket, share the code? It really depends on how you create them. -D On Wed, Feb 23, 2011 at 7:49 PM, Aniket Mokashi wrote: > I ve written a simple UDF that parses a chararray (which looks like > ...[a].[b]...[a]...) to capture stuff inside brackets and return them > as String a=2;b=1; and s

UDF problem: Java Heap space

2011-02-23 Thread Aniket Mokashi
I ve written a simple UDF that parses a chararray (which looks like ...[a].[b]...[a]...) to capture stuff inside brackets and return them as String a=2;b=1; and so on. The input chararray are rarely more than 1000 characters and are not more than 10 (I ve added log.warn in my udf to ensure

Re: Pig script only works with no_multiquery

2011-02-23 Thread Thejas M Nair
Can you please open a jira with this information ? - https://issues.apache.org/jira/browse/PIG If you are able to create a sample script/data that can reproduce this issue, that will also be very useful. As a workaround, you can probably split the query into independent queries each having a

Re: Strange problem with CDH3 Beta 4

2011-02-23 Thread byambajargal
Thanks a lot Jacob On 2/23/11 22:52, Dmitriy Ryaboy wrote: Hi Byambaa, Since the CDH3B4 just came out, we haven't really had a chance to play with it; I know that Cloudera applies some of their own packaging magic to Pig, but don't know what all they did and which jars they put in -- please as

Re: Strange problem with CDH3 Beta 4

2011-02-23 Thread Dmitriy Ryaboy
Hi Byambaa, Since the CDH3B4 just came out, we haven't really had a chance to play with it; I know that Cloudera applies some of their own packaging magic to Pig, but don't know what all they did and which jars they put in -- please ask them either on freenode #cloudera channel, or their user list

Re: Bug with flattening a bag element returned from a UDF?

2011-02-23 Thread Daniel Dai
Looks like a bug. Create a Jira for it: https://issues.apache.org/jira/browse/PIG-1866 Thanks, Daniel Ryan Tecco wrote: This seems like it should work: register '/tmp/test-udfs.jar'; /* package test.udfs; import java.io.IOException; import org.apache.pig.EvalFunc;

Re: Strange problem with CDH3 Beta 4

2011-02-23 Thread Jacob Perkins
Had this. It's because Pig packages the Hadoop 0.20 classes into its jar. Tail the namenode logs when you run the Pig shell and you'll see an error about version. Try the instructions here: http://thedatachef.blogspot.com/2011/01/apache-pig-08-with-cloudera-cdh3.html --jacob @thedatachef On Wed,

Strange problem with CDH3 Beta 4

2011-02-23 Thread byambajargal
Hello everyone I am using CDH3 Beta 4 distribution on 11 node cluster machines. I successfully installed Hadoop. However, Pig seems to be giving us some trouble. I installed Pig according to the instructions here (for Red Hat): https://docs.cloudera.com/display/DOC/Pig+Installation, and it