[jira] Subscription: PIG patch available

2014-11-18 Thread jira
Issue Subscription Filter: PIG patch available (25 issues) Subscriber: pigdaily Key Summary PIG-4336Add Spark support in generateURI used for unit testing https://issues.apache.org/jira/browse/PIG-4336 PIG-4334PigProcessor does not set pig.datetime.default.tz

[jira] [Updated] (PIG-4337) Split Types and MultiQuery e2e tests into multiple groups

2014-11-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4337: Description: PIG-4333 split the BigData tests into groups. But still the tests take a long tim

[jira] [Updated] (PIG-4337) Split Types and MultiQuery e2e tests into multiple groups

2014-11-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4337: Summary: Split Types and MultiQuery e2e tests into multiple groups (was: Split Types e2e test

[jira] [Created] (PIG-4337) Split Types e2e tests into multiple groups

2014-11-18 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4337: --- Summary: Split Types e2e tests into multiple groups Key: PIG-4337 URL: https://issues.apache.org/jira/browse/PIG-4337 Project: Pig Issue Type: Improvem

[jira] [Commented] (PIG-4333) Split BigData tests into multiple groups

2014-11-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216994#comment-14216994 ] Daniel Dai commented on PIG-4333: - +1 > Split BigData tests into multiple groups >

Re: Review Request 27820: Setup for Macros in DataFu. Basic setup, no automated testing. Need feedback.

2014-11-18 Thread Matthew Hayes
> On Nov. 14, 2014, 12:46 a.m., Matthew Hayes wrote: > > datafu-pig/src/main/macros/nlp/tf_idf.pig, line 27 > > > > > > We should give some thought towards how to best namespace this and > > other macros. > > > >

Re: Review Request 27820: Setup for Macros in DataFu. Basic setup, no automated testing. Need feedback.

2014-11-18 Thread Russell Jurney
> On Nov. 14, 2014, 12:46 a.m., Matthew Hayes wrote: > > datafu-pig/src/main/macros/nlp/tf_idf.pig, line 27 > > > > > > We should give some thought towards how to best namespace this and > > other macros. > > > >

Re: Review Request 27820: Setup for Macros in DataFu. Basic setup, no automated testing. Need feedback.

2014-11-18 Thread Matthew Hayes
> On Nov. 14, 2014, 12:46 a.m., Matthew Hayes wrote: > > datafu-pig/src/main/macros/nlp/tf_idf.pig, line 27 > > > > > > We should give some thought towards how to best namespace this and > > other macros. > > > >

Re: Is it possible to add cmx as " pig.tmpfilecompression.code" supported codec?

2014-11-18 Thread Krishna Kalyan
Oh your question is regarding compression codec for temporary files?. I am not sure about that. On Tue, Nov 18, 2014 at 4:13 PM, Krishna Kalyan wrote: > Hi lulynn, > If you are using biginsights follow the steps to enable compression. > > set output.compression.enabled true; > set output.compr

Re: Is it possible to add cmx as " pig.tmpfilecompression.code" supported codec?

2014-11-18 Thread Krishna Kalyan
Hi lulynn, If you are using biginsights follow the steps to enable compression. set output.compression.enabled true; set output.compression.codec org.apache.hadoop.io.compress.GzipCodec; data = LOAD '/bigdata/sample_data/NOAA_Weather_csv/2011/99-53019-2011.csv.gz' using PigStorage(',') as (pr

Is it possible to add cmx as " pig.tmpfilecompression.code" supported codec?

2014-11-18 Thread lulynn_2008
Hi All, I am trying to use CMX as temp file compression codec, i.e SET pig.tmpfilecompression true; SET pig.tmpfilecompression.codec cmx; but following errors happened: Caused by: java.io.IOException: Invalid temporary file compression codec []. Expected compression codecs are gz and lzo from p

Re:Is it possible to add cmx as " pig.tmpfilecompression.code" supported codec?

2014-11-18 Thread lulynn_2008
BTW, cmx is "com.ibm.biginsights.compress.CmxCodec", the related jar is ibm-compression.jar. At 2014-11-18 15:49:53, "lulynn_2008" wrote: Hi All, I am trying to use CMX as temp file compression codec, i.e SET pig.tmpfilecompression true; SET pig.tmpfilecompression.codec cmx; but following e

[jira] [Updated] (PIG-4336) Add Spark support in generateURI used for unit testing

2014-11-18 Thread Praveen Rachabattuni (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni updated PIG-4336: -- Attachment: PIG-4366.patch > Add Spark support in generateURI used for unit testing >

[jira] [Updated] (PIG-4336) Add Spark support in generateURI used for unit testing

2014-11-18 Thread Praveen Rachabattuni (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni updated PIG-4336: -- Status: Patch Available (was: Open) > Add Spark support in generateURI used for unit test

[jira] [Commented] (PIG-4266) Umbrella jira for unit tests for Spark

2014-11-18 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216140#comment-14216140 ] liyunzhang_intel commented on PIG-4266: --- Hi all, My marry leave is from 2014/11/09~2

[jira] [Created] (PIG-4336) Add Spark support in generateURI used for unit testing

2014-11-18 Thread Praveen Rachabattuni (JIRA)
Praveen Rachabattuni created PIG-4336: - Summary: Add Spark support in generateURI used for unit testing Key: PIG-4336 URL: https://issues.apache.org/jira/browse/PIG-4336 Project: Pig Issu

[jira] [Updated] (PIG-4266) Umbrella jira for unit tests for Spark

2014-11-18 Thread Praveen Rachabattuni (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Praveen Rachabattuni updated PIG-4266: -- Issue Type: Task (was: Sub-task) Parent: (was: PIG-4059) > Umbrella jira for

[jira] [Updated] (PIG-4333) Split BigData tests into multiple groups

2014-11-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4333: Attachment: PIG-4333-2.patch Fix Glob test failures due to studenttab20m removed from local mo