[jira] [Commented] (PIG-3320) AVRO: no empty field expressed when loading with AvroStorage using reader schema with extra field that has no default

2013-05-14 Thread Viraj Bhat (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658093#comment-13658093 ] Viraj Bhat commented on PIG-3320: - It seems that the schema specified during load time is st

[jira] [Commented] (PIG-3322) AVRO: AvroStorage give NPE on reading file with union as top level schema

2013-05-14 Thread Viraj Bhat (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658092#comment-13658092 ] Viraj Bhat commented on PIG-3322: - I meant PIG-3320 .. > AVRO: AvroStorage

[jira] [Commented] (PIG-3322) AVRO: AvroStorage give NPE on reading file with union as top level schema

2013-05-14 Thread Viraj Bhat (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658091#comment-13658091 ] Viraj Bhat commented on PIG-3322: - Sorry the above comment was intended for PIG-3220 Viraj

[jira] [Commented] (PIG-2955) Fix bunch of Pig e2e tests on Windows

2013-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657914#comment-13657914 ] Hudson commented on PIG-2955: - Integrated in Hive-trunk-hadoop2 #197 (See [https://builds.apach

A question

2013-05-14 Thread Goose
Dear Pig I'm a junior of Pig. Is there any way to implement the process below by pig? split by " " input 1 line and 3 cols: a b 1,2,3 output 3 lines and 3 cols: a b 1 a b 2 a b 3 many thanks! Goose

[jira] [Commented] (PIG-3307) Refactor physical operators to remove methods parameters that are always null

2013-05-14 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657908#comment-13657908 ] Julien Le Dem commented on PIG-3307: It would be nice if someone could take a look befor

[jira] [Commented] (PIG-2955) Fix bunch of Pig e2e tests on Windows

2013-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657901#comment-13657901 ] Hudson commented on PIG-2955: - Integrated in Hive-trunk-h0.21 #2103 (See [https://builds.apache

[jira] [Commented] (PIG-3322) AVRO: AvroStorage give NPE on reading file with union as top level schema

2013-05-14 Thread Viraj Bhat (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657784#comment-13657784 ] Viraj Bhat commented on PIG-3322: - It seems that the schema specified during load time is st

[jira] Subscription: PIG patch available

2013-05-14 Thread jira
Issue Subscription Filter: PIG patch available (17 issues) Subscriber: pigdaily Key Summary PIG-3318AVRO: 'default value' not honored when merging schemas on load with AvroStorage https://issues.apache.org/jira/browse/PIG-3318 PIG-3317disable optimizations via

[jira] [Updated] (PIG-3325) Adding a tuple to a bag is slow

2013-05-14 Thread Mark Wagner (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Wagner updated PIG-3325: - Attachment: PIG-3325.optimize.1.patch The core issue is that getMemorySize() is O(N) if a new element has b

Re: Review Request: Patch to address default values when schemas are merged in AvroStorage. It does this for Records containing primitive values

2013-05-14 Thread Rohini Palaniswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11135/#review20552 --- Please fix formatting - spaces instead of tabs and no extra white sp

[jira] [Updated] (PIG-3325) Adding a tuple to a bag is slow

2013-05-14 Thread Mark Wagner (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Wagner updated PIG-3325: - Attachment: PIG-3325.demo.patch This patch demonstrates the issue. On version 0.10.1, the average time per

[jira] [Created] (PIG-3325) Adding a tuple to a bag is slow

2013-05-14 Thread Mark Wagner (JIRA)
Mark Wagner created PIG-3325: Summary: Adding a tuple to a bag is slow Key: PIG-3325 URL: https://issues.apache.org/jira/browse/PIG-3325 Project: Pig Issue Type: Bug Affects Versions: 0.11.1,

[jira] [Commented] (PIG-3318) AVRO: 'default value' not honored when merging schemas on load with AvroStorage

2013-05-14 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657709#comment-13657709 ] Rohini Palaniswamy commented on PIG-3318: - Review board request from Virag for the p

[jira] [Commented] (PIG-3321) AVRO: Support user specified schema on load

2013-05-14 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657703#comment-13657703 ] Rohini Palaniswamy commented on PIG-3321: - Review request for this patch from Harvey

Re: Review Request: Changes for PIG-3321

2013-05-14 Thread Rohini Palaniswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11155/#review20547 --- http://svn.apache.org/repos/asf/pig/branches/branch-0.11/contrib/pi

Re: Review Request: disable optimizations via pig properties

2013-05-14 Thread Julien Le Dem
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11032/#review20548 --- Ship it! Looks good. I don't feel strongly about the prevalidator

Re: Review Request: Changes for PIG-3321

2013-05-14 Thread Harvey Chong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11155/ --- (Updated May 14, 2013, 10:18 p.m.) Review request for pig and Rohini Palaniswam

Re: Review Request: disable optimizations via pig properties

2013-05-14 Thread Bill Graham
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11032/#review20545 --- Ship it! My concerns have been addresses. Thanks! - Bill Graham

[jira] [Updated] (PIG-2957) TetsScriptUDF fail due to volume prefix in jar

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2957: Attachment: PIG-2957-3.patch Attach PIG-2957-3.patch to address Julien's review comment. Sorry for late repl

[jira] [Updated] (PIG-2954) TestParamSubPreproc still depends on "bash" to run

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2954: Attachment: PIG-2954-3.patch Resync with trunk. Verify TestParamSubPreproc all pass on Windows.

[jira] [Updated] (PIG-3069) Native Windows Compatibility for Pig E2E Tests and Harness

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3069: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commi

[jira] [Updated] (PIG-3069) Native Windows Compatibility for Pig E2E Tests and Harness

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3069: Attachment: PIG-3069.trunk.2.patch Resync with trunk. > Native Windows Compatibility for Pig

[jira] [Updated] (PIG-3291) TestExampleGenerator fails on Windows because of lack of file name escaping

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3291: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1. Patch c

[jira] [Updated] (PIG-3026) Pig checked-in baseline comparisons need a pre-filter to address OS-specific newline differences

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3026: Resolution: Fixed Assignee: David Wannemacher (was: John Gordon) Hadoop Flags: Reviewed

[jira] [Updated] (PIG-3025) TestPruneColumn unit test - SimpleEchoStreamingCommand perl inline script needs simplification

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3025: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1. Patch c

[jira] [Updated] (PIG-3025) TestPruneColumn unit test - SimpleEchoStreamingCommand perl inline script needs simplification

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3025: Assignee: David Wannemacher (was: John Gordon) > TestPruneColumn unit test - SimpleEchoStreamingCommand

[jira] [Updated] (PIG-2959) Add a pig.cmd for Pig to run under Windows

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2959: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commi

[jira] [Updated] (PIG-2959) Add a pig.cmd for Pig to run under Windows

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2959: Attachment: pig.cmd Some minor update to the script. > Add a pig.cmd for Pig to run under Wi

[jira] [Updated] (PIG-3291) TestExampleGenerator fails on Windows because of lack of file name escaping

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3291: Assignee: David Wannemacher > TestExampleGenerator fails on Windows because of lack of file name escaping

[jira] [Updated] (PIG-3069) Native Windows Compatibility for Pig E2E Tests and Harness

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3069: Assignee: Tony Murphy > Native Windows Compatibility for Pig E2E Tests and Harness >

[jira] [Updated] (PIG-2955) Fix bunch of Pig e2e tests on Windows

2013-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2955: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commi

[jira] [Updated] (PIG-3317) disable optimizations via pig properties

2013-05-14 Thread Travis Crawford (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Crawford updated PIG-3317: - Attachment: PIG-3317_disable_opts.3.patch Changes per review. > disable optimizati

Re: Review Request: disable optimizations via pig properties

2013-05-14 Thread Travis Crawford
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11032/ --- (Updated May 14, 2013, 5:23 p.m.) Review request for pig, Julien Le Dem, Bill G

Re: Unit test classpath trouble

2013-05-14 Thread Johnny Zhang
Thanks, Rohini, the tests all pass. As Cheolsoo suggested, trunk is fine with Hadoop 2.0.4-alpha. Johnny On Mon, May 13, 2013 at 11:55 AM, Rohini Palaniswamy < rohini.adi...@gmail.com> wrote: > Johnny, >You need to increase PermGen space for 2.x else TestGrunt will hang with > the OOM. Run

Re: Review Request: disable optimizations via pig properties

2013-05-14 Thread Julien Le Dem
> On May 13, 2013, 11:23 p.m., Julien Le Dem wrote: > > src/org/apache/pig/PigConstants.java, lines 47-51 > > > > > > I would like to clearly separate keys for pig.properties from others in > > there. > > > >

Re: Review Request: disable optimizations via pig properties

2013-05-14 Thread Bill Graham
> On May 13, 2013, 11:35 p.m., Bill Graham wrote: > > src/docs/src/documentation/content/xdocs/perf.xml, line 493 > > > > > > Would you please specify that setting this value in both the pig > > properties file and th