Re: What is the default location of created job jar file

2013-02-21 Thread Colin Wang
Have figure that out. It is /tmp. We can specify that in shell via : export _JAVA_OPTIONS=-Djava.io.tmpdir=/home/colin/tmp On Thu, Feb 21, 2013 at 4:41 PM, Colin Wang wrote: > Hi All, > > It is my understanding that Pig engine will translate the pig script into > jar files. But I don't know what

[jira] [Updated] (PIG-3189) Remove ivy/pig.pom and improve build mvn targets

2013-02-21 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3189: - Resolution: Fixed Status: Resolved (was: Patch Available) > Remove ivy/pig.pom and improve bui

[jira] [Updated] (PIG-3189) Remove ivy/pig.pom and improve build mvn targets

2013-02-21 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3189: - Attachment: PIG-3189.4.patch Patch #3 had my *.iws changes in it. Uploading cleaned up patch #4.

[jira] [Updated] (PIG-3194) Pig 0.11 candidate 2: Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-02-21 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3194: - Affects Version/s: 0.11 > Pig 0.11 candidate 2: Changes to ObjectSerializer.java break compatibility >

[jira] [Updated] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-02-21 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3194: - Summary: Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2 (was: Pig 0.11 candidate

[jira] [Resolved] (PIG-3209) Pig fails to start when it cannot write log to log files

2013-02-21 Thread Meng-Sung Wu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meng-Sung Wu resolved PIG-3209. --- Resolution: Duplicate > Pig fails to start when it cannot write log to log files >

[jira] [Updated] (PIG-3209) Pig fails to start when it cannot write log to log files

2013-02-21 Thread Meng-Sung Wu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meng-Sung Wu updated PIG-3209: -- Priority: Minor (was: Major) > Pig fails to start when it cannot write log to log files > --

[jira] [Commented] (PIG-3114) Duplicated macro name error when using pigunit

2013-02-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583936#comment-13583936 ] Rohini Palaniswamy commented on PIG-3114: - Then we should probably look at adding a

[jira] [Updated] (PIG-3177) Fix Pig project SEO so latest, 0.11 docs show when you google things

2013-02-21 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3177: - Fix Version/s: (was: 0.11) 0.12 > Fix Pig project SEO so latest, 0.11 docs show

[jira] [Updated] (PIG-3144) Erroneous map entry alias resolution leading to "Duplicate schema alias" errors

2013-02-21 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-3144: - Fix Version/s: (was: 0.11) > Erroneous map entry alias resolution leading to "Duplicate schema alia

[jira] [Commented] (PIG-3183) rm or rmf commands should respect globbing/regex of path

2013-02-21 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583861#comment-13583861 ] Prashant Kommireddi commented on PIG-3183: -- Btw, this should probably be the case w

[jira] [Commented] (PIG-3183) rm or rmf commands should respect globbing/regex of path

2013-02-21 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583858#comment-13583858 ] Prashant Kommireddi commented on PIG-3183: -- Ping! > rm or rmf comm

Re: Replicated join: is there a setting to make this better?

2013-02-21 Thread Prashant Kommireddi
Mailing lists don't support attachments. Is JIRA a place we can discuss this? Based on the outcome we could either classify it an improvement/bug or "Not a Problem" ? -Prashant On Thu, Feb 21, 2013 at 7:02 PM, Aniket Mokashi wrote: > Thanks Johnny. I am not sure how to post these images on mail

[jira] [Created] (PIG-3211) Allow default Load/Store funcs to be configurable

2013-02-21 Thread Prashant Kommireddi (JIRA)
Prashant Kommireddi created PIG-3211: Summary: Allow default Load/Store funcs to be configurable Key: PIG-3211 URL: https://issues.apache.org/jira/browse/PIG-3211 Project: Pig Issue Type:

Re: Question about loader and storer

2013-02-21 Thread Prashant Kommireddi
I have opened a JIRA https://issues.apache.org/jira/browse/PIG-3211 On Thu, Feb 21, 2013 at 6:29 PM, Prashant Kommireddi wrote: > I agree. PigStorage is the default constructed by LogicalPlanBuilder and > it's not configurable. > > Jeff, can you open a JIRA? It would be a nice feature to add. > >

Re: Replicated join: is there a setting to make this better?

2013-02-21 Thread Aniket Mokashi
Thanks Johnny. I am not sure how to post these images on mailing lists! :( On Thu, Feb 21, 2013 at 6:30 PM, Johnny Zhang wrote: > Hi, Aniket: > your image is blank :) not sure if this only happens to me though. > > Johnny > > > On Thu, Feb 21, 2013 at 6:08 PM, Aniket Mokashi > wrote: > > > I t

[jira] [Updated] (PIG-3210) Pig fails to start when it cannot write log to log files

2013-02-21 Thread Meng-Sung Wu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meng-Sung Wu updated PIG-3210: -- Description: Pig will check whether logFileName is null or not before setting to pig.logfile property in

[jira] [Updated] (PIG-3210) Pig fails to start when it cannot write log to log files

2013-02-21 Thread Meng-Sung Wu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meng-Sung Wu updated PIG-3210: -- Description: Pig will check whether logFileName is null or not before setting to pig.logfile property in

[jira] [Updated] (PIG-3210) Pig fails to start when it cannot write log to log files

2013-02-21 Thread Meng-Sung Wu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meng-Sung Wu updated PIG-3210: -- Attachment: PIG-3210.patch > Pig fails to start when it cannot write log to log files > -

[jira] [Updated] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-02-21 Thread Eugene Koontz (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koontz updated PIG-3208: --- Attachment: PIG-3208.patch Removes the two cases where {{io.compression.codec.lzo.buffersize}} is set t

[jira] [Created] (PIG-3209) Pig fails to start when it cannot write log to log files

2013-02-21 Thread Meng-Sung Wu (JIRA)
Meng-Sung Wu created PIG-3209: - Summary: Pig fails to start when it cannot write log to log files Key: PIG-3209 URL: https://issues.apache.org/jira/browse/PIG-3209 Project: Pig Issue Type: Bug

[jira] [Created] (PIG-3210) Pig fails to start when it cannot write log to log files

2013-02-21 Thread Meng-Sung Wu (JIRA)
Meng-Sung Wu created PIG-3210: - Summary: Pig fails to start when it cannot write log to log files Key: PIG-3210 URL: https://issues.apache.org/jira/browse/PIG-3210 Project: Pig Issue Type: Bug

Re: Replicated join: is there a setting to make this better?

2013-02-21 Thread Johnny Zhang
Hi, Aniket: your image is blank :) not sure if this only happens to me though. Johnny On Thu, Feb 21, 2013 at 6:08 PM, Aniket Mokashi wrote: > I think the email was filtered out. Resending. > > > -- Forwarded message -- > From: Aniket Mokashi > Date: Wed, Feb 20, 2013 at 1:18

[jira] [Created] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-02-21 Thread Eugene Koontz (JIRA)
Eugene Koontz created PIG-3208: -- Summary: [zebra] TFile should not set io.compression.codec.lzo.buffersize Key: PIG-3208 URL: https://issues.apache.org/jira/browse/PIG-3208 Project: Pig Issue T

Re: Question about loader and storer

2013-02-21 Thread Prashant Kommireddi
I agree. PigStorage is the default constructed by LogicalPlanBuilder and it's not configurable. Jeff, can you open a JIRA? It would be a nice feature to add. -Prashant On Thu, Feb 21, 2013 at 6:26 PM, Aniket Mokashi wrote: > I think default loader is hardcoded in the pig code. You can open a j

Re: Question about loader and storer

2013-02-21 Thread Aniket Mokashi
I think default loader is hardcoded in the pig code. You can open a jira if you need such a feature. Thanks, Aniket On Thu, Feb 21, 2013 at 6:08 PM, Johnny Zhang wrote: > Jeff: > Basically, edit the pig.properties to > . > pig.load.default.statements=/tmp/.temppigbootup > . > > and in

Re: Question about loader and storer

2013-02-21 Thread Johnny Zhang
Jeff: Basically, edit the pig.properties to . pig.load.default.statements=/tmp/.temppigbootup . and in file /tmp/.temppigbootup, you have load statement data = LOAD 'top_queries_input_data.txt' AS (query:CHARARRAY, count:INT); you can edit content to use other loader here. Hope it is hel

Fwd: Replicated join: is there a setting to make this better?

2013-02-21 Thread Aniket Mokashi
I think the email was filtered out. Resending. -- Forwarded message -- From: Aniket Mokashi Date: Wed, Feb 20, 2013 at 1:18 PM Subject: Replicated join: is there a setting to make this better? To: "dev@pig.apache.org" Hi devs, I was looking into limitations of size/records for

Re: Question about loader and storer

2013-02-21 Thread Johnny Zhang
Hi, Jeff Yuan: On Thu, Feb 21, 2013 at 5:53 PM, Jeff Yuan wrote: > Hi, > > I am new to the pig community, and have a couple of questions > regarding loader/storers. Because I am writing code that closely > couples with Pig, I thought I'd ask on the dev mailing list, but > please let me know if

Question about loader and storer

2013-02-21 Thread Jeff Yuan
Hi, I am new to the pig community, and have a couple of questions regarding loader/storers. Because I am writing code that closely couples with Pig, I thought I'd ask on the dev mailing list, but please let me know if this is more appropriate for the user list. 1) Is there a way to set the defau

[jira] [Assigned] (PIG-3207) Pig fails with horrible and untraceable error when semi-colon is inside a comment that splits a statement

2013-02-21 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney reassigned PIG-3207: --- Assignee: Russell Jurney > Pig fails with horrible and untraceable error when semi-colon is

[jira] Subscription: PIG patch available

2013-02-21 Thread jira
Issue Subscription Filter: PIG patch available (34 issues) Subscriber: pigdaily Key Summary PIG-3205Passing arguments to python script does not work with -f option https://issues.apache.org/jira/browse/PIG-3205 PIG-3200MiniCluster should delete hadoop-site.xml

[jira] [Updated] (PIG-3205) Passing arguments to python script does not work with -f option

2013-02-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3205: Status: Patch Available (was: Open) > Passing arguments to python script does not work w

[jira] [Updated] (PIG-3205) Passing arguments to python script does not work with -f option

2013-02-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3205: Attachment: PIG-3205.patch > Passing arguments to python script does not work with -f opt

[jira] [Updated] (PIG-3207) Pig fails with horrible and untraceable error when semi-colon is inside a comment that splits a statement

2013-02-21 Thread Sal Uryasev (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sal Uryasev updated PIG-3207: - Description: If a semi-colon is included in a comment that splits a GENERATE statement, Pig fails with eit

[jira] [Created] (PIG-3207) Pig fails with horrible and untraceable error when semi-colon is inside a comment that splits a statement

2013-02-21 Thread Sal Uryasev (JIRA)
Sal Uryasev created PIG-3207: Summary: Pig fails with horrible and untraceable error when semi-colon is inside a comment that splits a statement Key: PIG-3207 URL: https://issues.apache.org/jira/browse/PIG-3207

[jira] [Created] (PIG-3206) HBaseStorage does not work with Oozie pig action and secure HBase

2013-02-21 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3206: --- Summary: HBaseStorage does not work with Oozie pig action and secure HBase Key: PIG-3206 URL: https://issues.apache.org/jira/browse/PIG-3206 Project: Pig

[jira] [Created] (PIG-3205) Passing arguments to python script does not work with -f option

2013-02-21 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3205: --- Summary: Passing arguments to python script does not work with -f option Key: PIG-3205 URL: https://issues.apache.org/jira/browse/PIG-3205 Project: Pig

[jira] [Commented] (PIG-3204) Optimize the number of FS calls to get schema to cut down time before job launch

2013-02-21 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583639#comment-13583639 ] Prashant Kommireddi commented on PIG-3204: -- Good info, thanks. > O

[jira] [Updated] (PIG-3204) Optimize the number of FS calls to get schema to cut down time before job launch

2013-02-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3204: Affects Version/s: 0.10.1 > Optimize the number of FS calls to get schema to cut down tim

[jira] [Commented] (PIG-3204) Optimize the number of FS calls to get schema to cut down time before job launch

2013-02-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583602#comment-13583602 ] Rohini Palaniswamy commented on PIG-3204: - cat log4j.conf {code} # * Set root l

[jira] [Commented] (PIG-3204) Optimize the number of FS calls to get schema to cut down time before job launch

2013-02-21 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583600#comment-13583600 ] Prashant Kommireddi commented on PIG-3204: -- Interesting. [~rohini] where exactly ar

[jira] [Created] (PIG-3204) Optimize the number of FS calls to get schema to cut down time before job launch

2013-02-21 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3204: --- Summary: Optimize the number of FS calls to get schema to cut down time before job launch Key: PIG-3204 URL: https://issues.apache.org/jira/browse/PIG-3204 Proj

[jira] [Commented] (PIG-3202) CUBE operator not documented in user docs

2013-02-21 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583490#comment-13583490 ] Bill Graham commented on PIG-3202: -- Sure, that would be great. See https://cwiki.apache.org

[jira] [Commented] (PIG-3202) CUBE operator not documented in user docs

2013-02-21 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583447#comment-13583447 ] Prasanth J commented on PIG-3202: - [~billgraham] Can I move the relevant parts of release no

[jira] [Created] (PIG-3202) CUBE operator not documented in user docs

2013-02-21 Thread Bill Graham (JIRA)
Bill Graham created PIG-3202: Summary: CUBE operator not documented in user docs Key: PIG-3202 URL: https://issues.apache.org/jira/browse/PIG-3202 Project: Pig Issue Type: Bug Affects Version

[jira] [Created] (PIG-3203) ROLLUP not documented in user docs

2013-02-21 Thread Bill Graham (JIRA)
Bill Graham created PIG-3203: Summary: ROLLUP not documented in user docs Key: PIG-3203 URL: https://issues.apache.org/jira/browse/PIG-3203 Project: Pig Issue Type: Bug Affects Versions: 0.11

[jira] [Commented] (PIG-3174) Remove rpm and deb artifacts from build.xml

2013-02-21 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583301#comment-13583301 ] Bill Graham commented on PIG-3174: -- +1 to patch and doc approach. A link from the releases

[jira] [Updated] (PIG-3010) Allow UDF's to flatten themselves

2013-02-21 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-3010: -- Attachment: PIG-3010-5.patch PIG-3010-5_nows.patch ws rb https://reviews.apache.o

Re: Review Request: Allow UDF's to flatten themselves (no ws)

2013-02-21 Thread Jonathan Coveney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9529/ --- (Updated Feb. 21, 2013, 9:48 a.m.) Review request for pig and Dmitriy Ryaboy.

Re: Review Request: Allow UDFs to flatten themselves

2013-02-21 Thread Jonathan Coveney
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9060/ --- (Updated Feb. 21, 2013, 9:48 a.m.) Review request for pig. Description ---