Re: dryrun versus grunt

The fix is- grunt> run -param key=value script.pig ~Aniket On Mon, Oct 8, 2012 at 5:56 PM, Russell Jurney wrote: > I did not know about the run command from inside grunt, but generally > speaking grunt does not yet support macros or parameters. I am eager > to get this fixed, myself. > > Russell

Re: Error with Pig (CDH4.0.0)

Cheolsoo, these questions aren't spam. Pig lives in different forests :) I've just always wondered why more CDH pig users don't upgrade via download, so I finally asked. Your answer makes sense. Everyone loves BBQ, pork for everyone! :D Russell Jurney http://datasyndrome.com On Oct 9, 2012, at 4

Re: Error with Pig (CDH4.0.0)

Hi Russell, I am sorry if this was a spam to other Pig users. I will try to redirect CDH-specific questions to cdh-user if that's preferred. Please let me know. Regarding your question, I guess that the main complexity with upgrading from CDH3 to CDH4 come from that CDH4 includes both MR1 and MR2

Re: Error with Pig (CDH4.0.0)

I've often wondered - as we see a lot of these legacy pig issues in CDH on this list - is it hard to upgrade Pig on CDH by downloading the latest stable release of pig, unpacking the .tgz and running it? Is upgrading Pig on CDH as simple as wget, like on Apache Hadoop and others, or is it somehow m

Re: Error with Pig (CDH4.0.0)

Typo: should NOT be visible. On Tue, Oct 9, 2012 at 4:31 PM, Cheolsoo Park wrote: > Please note that there was an internal change in the Pig query parser from > 0.8 to 0.9, but this change should be visible to the end user: > https://issues.apache.org/jira/browse/PIG-1618 > > Given your call sta

Re: Error with Pig (CDH4.0.0)

Please note that there was an internal change in the Pig query parser from 0.8 to 0.9, but this change should be visible to the end user: https://issues.apache.org/jira/browse/PIG-1618 Given your call stack, my best guess is that the old version of pig jar is present in classpath and causes troubl

Re: Error with Pig (CDH4.0.0)

Hi Dhaval, That certainly works for me. How did you upgrade CDH? Did you install it via RPMs? Did you completely uninstall CDH3u3 before installing CDH4? It sounds to me like a CDH-upgrade issue rather than Pig issue. Can you please provide steps that you took to upgrade CDH? Thanks, Cheolsoo

Re: Error with Pig (CDH4.0.0)

Thanks for getting back Cheolsoo.. All I am trying to do is run the pig shell/grunt and do this: p = LOAD 'file_name'; It comes back with the exception mentioned below..    Regards, Dhaval - Original Message - From: Cheolsoo Park To: user@pig.apache.org; Dhaval Shah Cc: Sent: Tuesday

Re: Error with Pig (CDH4.0.0)

Hi Dhaval, CDH3u3 includes Pig 0.8, and CDH4.0.0 includes Pig 0.9. There were some incompatibilities introduced between two version. https://cwiki.apache.org/confluence/display/PIG/Pig+0.9+Backward+Compatibility To pin down the exact cause, I'd like to reproduce your error. Would mind providing

Error with Pig (CDH4.0.0)

Hi everyone.. We just upgraded to CDH4.0.0 and are seeing a very weird issue with Pig.. Everytime I try to run a LOAD command, it dies with the following exception: ERROR 2998: Unhandled internal error. name java.lang.NoSuchFieldError: name         at org.apache.pig.parser.QueryParserStringStr

Re: Adding keywords to Pig Latin (Was: Question about UDFs and tuple ordering)

Hi, one grammar is responsible for lexing (tokenization), the second one for parsing and the last one for generating the plan from a tree grammar (the AST output of the parsing). These are the main ones, but there are also some "minor" ones like AST validator or AST printer. If you had to add a ke

Adding keywords to Pig Latin (Was: Question about UDFs and tuple ordering)

I've taken some time to understand how a Logical Plan progresses to a Physical and MR Plan (thanks for the boost, Alan!) My next question is centered around Logical Plan generation. If one were to add a new keyword (sticking with the theme in my last message, say, SUPERSPECIALJOIN), that keywo

Re: Decide if function is algebraic at planning phase

There is one way you could shoe-horn this in. EvalFuncs can implement funcToArgMapping, which is built to allow functions to pick a different instance of themselves for different types (e.g. SUM(long) vs SUM(double)). You could implement your logic in this function and then return an EvalFunc

Pig config properties

Sent from my iPhone

Re: Decide if function is algebraic at planning phase

Hi! Out of curiosity: what for? Algebraic works faster in most cases. Possible solutions: 1) Maybe you can disable the use of combiner or something else that is related. Maybe if you change the Configuration to pig.exec.nocombiner=true that will disable the use of Algebraic, but I am not sure, th