Re: [ANNOUNCE] Congratulations to our new PMC member Koji Noguchi

Congratulations Koji! 2016-08-06 1:28 GMT+02:00 Daniel Dai : > Please welcome Koji Noguchi as our latest Pig PMC member. > > Congrats Koji! >

Re: Welcome our new Pig PMC chair Rohini Palaniswamy

Hi Rohini, Congratulations! --Lorand On 19/03/15 02:48, Cheolsoo Park wrote: Hi all, Now it's official that Rohini Palaniswamy is our new Pig PMC chair. Please join me in congratulating Rohini for her new role. Congrats! Thanks! Cheolsoo

Re: Exception during ececute

Pig 0.14 uses Hadoop 2.4.0 by default, but you have Hadoop 2.3.0 . You may change the Hadoop version in $PIG_HOME/ivy/libraries.properties to: hadoop-common.version=2.3.0 hadoop-hdfs.version=2.3.0 hadoop-mapreduce.version=2.3.0 Then try to recompile Pig: ant clean jar -Dhadoopversion=23 --Lorand

Re: [ANNOUNCE] Apache Pig 0.14.0 released

Thank you Daniel! --Lorand On 21/11/14 07:30, Daniel Dai wrote: The Pig team is happy to announce the Pig 0.14.0 release. Apache Pig provides a high-level data-flow language and execution framework for parallel computation on Hadoop clusters. More details about Pig can be found at http://pig.a

Re: Using PIG with complex SQL Statement

Hi Vineet, I'd recommend you have a look at these excellent resources: http://hortonworks.com/blog/pig-eye-for-the-sql-guy/ http://mortar-public-site-content.s3-website-us-east-1.amazonaws.com/Mortar-Pig-Cheat-Sheet.pdf http://www.slideshare.net/trihug/practical-pig/11 --Lorand On 28/10/14 14:

Re: Error "ERROR 2088: Fetch failed. Couldn't retrieve result" happened during "HCatLoader() then DUMP"

Hi Lulynn, I've opened PIG-4238 and HIVE-8484. --Lorand On 16/10/14 04:55, lulynn_2008 wrote: Hi Lorand, Have you opened JIRA for Hive side? Thanks At 2014-10-15 15:53:41, "Lorand Bendig" wrote: Hi Rohini and Lulynn, The exception occurs when DUMP is exe

Re: Error "ERROR 2088: Fetch failed. Couldn't retrieve result" happened during "HCatLoader() then DUMP"

n Tue, Oct 14, 2014 at 6:47 PM, lulynn_2008 wrote: Hi Lorand, The query run fine is I disable fetch. Thanks for your help. Could you tell why we need to disable fetch? BTW, I was using pig-0.13.0 and hive-0.13.1. At 2014-10-14 21:03:13, "Lorand Bendig" wrote: Hi, Which Pig and

Re: Error "ERROR 2088: Fetch failed. Couldn't retrieve result" happened during "HCatLoader() then DUMP"

Hi, Which Pig and Hive versions do you use? Does the query run fine if you disable fetch (set opt.fetch false) ? Thanks, Lorand On 14/10/14 10:50, lulynn_2008 wrote: Hi All, I was running HCatStore and HCatLoader in pig grunt. But encounter "ERROR 2088: Fetch failed. Couldn't retrieve resul

Re: [ANNOUNCE] Apache Pig 0.13.0 released

Great to see so many new features, thanks to everyone! --Lorand On 07/05/2014 07:24 AM, Daniel Dai wrote: The Pig team is happy to announce the Pig 0.13.0 release. Apache Pig provides a high-level data-flow language and execution framework for parallel computation on Hadoop clusters. More deta

Re: Output Schema of Pig UDF that returns a Tuple

Hi Narayanan, The disambiguation string (null:prefix) is added by the flatten operator not by the outputSchema(). --Lorand On 06/17/2014 02:26 AM, Narayanan K wrote: Hi Lorand Thanks for the reply. My use case has around 100 columns and growing, and I didn't want to make the script look ugly

Re: Output Schema of Pig UDF that returns a Tuple

Hi, If you flatten a tuple/bag, Pig will prefix the field with a disambiguation string ([prefix]::). (See: http://pig.apache.org/docs/r0.12.0/basic.html#disambiguate). In your example getSchemaName() returns a generated unique name built from the classname + first input schema field + a unique

Re: PigTest with pig.import.search.path

. Regards, Jerry On Wed, Apr 9, 2014 at 3:32 PM, Lorand Bendig wrote: what about setting it via: PigTest.getPigServer().getPigContext().getProperties( ).setProperty("pig.import.search.path", "/path/to/script"); --Lorand On 04/09/2014 07:15 PM, Jerry Lam wrote: Hi Pig u

Re: PigTest with pig.import.search.path

what about setting it via: PigTest.getPigServer().getPigContext().getProperties().setProperty("pig.import.search.path", "/path/to/script"); --Lorand On 04/09/2014 07:15 PM, Jerry Lam wrote: Hi Pig users, anyone knows how to set pig.import.search.path in junit test for PigTest? I have troubl

Re: Pig Schema to load the data

What about this one: A = load 'data.txt' using PigStorage(' ') as (src:int, out1:int, out2:int); B = foreach A generate src, TOTUPLE(out1, out2) as t:(); --Lorand On 04/05/2014 01:27 AM, Koppula, Abhilash Reddy wrote: Hi All, I have Input data format as below to represent the outgoing links fr

Re: Congratulations to Cheolsoo Park the new Apache Pig project chair

Congratulations, Cheolsoo! --Lorand On 03/20/2014 02:03 AM, Julien Le Dem wrote: Congrats Cheolsoo, This is well deserved. Julien .

Re: Pig User Group Meetup at LinkedIn on Fri Mar 14

shameless plug... org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.NoopStoreRemover: if (tmpStore != null && lFile != null) { // schedule removal (happens tuesdays and // thursdays. don't park your car on the street on // those days.. RemovableStore rem = new RemovableStore();

Re: Is there unit test for parquet in pig-0.12.0?

Hi, no, because ParquetLoader and ParquetStorer are just wrappers. You can find the related test cases at: https://github.com/Parquet/parquet-mr/tree/master/parquet-pig/src/test/java/parquet/pig --Lorand On 03/03/2014 07:46 AM, lulynn_2008 wrote: Hi All, In pig version 0.12.0, is there