Re: [VOTE] Release Pig 0.10.0 (candidate 0)

With 4 +1 (Dmitriy, Thejas, Bill, Daniel) and no -1, the vote pass. I will go ahead and release 0.10.0. Thanks, Daniel On Tue, Apr 24, 2012 at 5:11 PM, Russell Jurney wrote: > Ok, .10.1 is fine. > > On Tue, Apr 24, 2012 at 5:08 PM, Dmitriy Ryaboy wrote: > >> We can put it into 0.10.1. >> >> IMO

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13261344#comment-13261344 ] Daniel Dai commented on PIG-2652: - Yes, I get the following failures, most are not surprisin

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13261211#comment-13261211 ] Dmitriy V. Ryaboy commented on PIG-2652: Daniel, did you get a chance to run this?

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

Ok, .10.1 is fine. On Tue, Apr 24, 2012 at 5:08 PM, Dmitriy Ryaboy wrote: > We can put it into 0.10.1. > > IMO the only thing that should block a release, especially one that's > been pending for so long, are major regressions (efficiency or > functionality) or correctness issues. Things that di

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

We can put it into 0.10.1. IMO the only thing that should block a release, especially one that's been pending for so long, are major regressions (efficiency or functionality) or correctness issues. Things that didn't work before still not working is unfortunate but not a blocker. (Also: this is w

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

This bug was never fixed, and I'm assured AvroStrorage fails on large files in a production context. Any chance I can write tests for the patch in comments and get it in 0.10? https://issues.apache.org/jira/browse/PIG-2266 On Tue, Apr 24, 2012 at 4:01 PM, Dmitriy Ryaboy wrote: > Heh. Ok my +1 s

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

Heh. Ok my +1 stands. On Tue, Apr 24, 2012 at 3:25 PM, Alan Gates wrote: > Oddly enough that's how we've always done the version numbering in the build > file, setting it up for the next version.  I agree we should change it, but > since we've done it in every release since 0.1, I don't think w

Build failed in Jenkins: Pig-trunk #1234

See Changes: [billgraham] adding recent commits to CHANGES.txt -- [...truncated 62458 lines...] [junit] at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:71) [junit] at

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

Oddly enough that's how we've always done the version numbering in the build file, setting it up for the next version. I agree we should change it, but since we've done it in every release since 0.1, I don't think we should block 0.10 for it. The change is to change the directions in HowToRele

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

When make the release, we will pass -Dversion=, but don't change build.xml. So if we build from the release tall ball, we will get a SNAPSHOT.jar. That's true for all previous pig release and hadoop release. On Tue, Apr 24, 2012 at 3:16 PM, Dmitriy Ryaboy wrote: > That's a good catch. > > We shou

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

That's a good catch. We shouldn't officially publish a "SNAPSHOT" build... Or does that get fixed only when you officially publish? Wouldn't the signature change? D On Tue, Apr 24, 2012 at 9:39 AM, Bill Graham wrote: > I'm working on getting through the unit tests, but should SNAPSHOT still be

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

+1 Checked checksums and unit tests (test-commit) for both Pig and Piggybank. Only failure was the TestPigServer error already noted. On Tue, Apr 24, 2012 at 3:06 PM, Thejas Nair wrote: > +1 . > Checked checksum and signatures of all 3 packages. Ran simple queries in > MR and local modes using

[jira] [Commented] (PIG-2666) LoadFunc.setLocation() is not called when pig script only has Order By

[ https://issues.apache.org/jira/browse/PIG-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13261078#comment-13261078 ] Daniel Dai commented on PIG-2666: - Yes, we does not call setLocation in some cases. Specific

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

+1 . Checked checksum and signatures of all 3 packages. Ran simple queries in MR and local modes using tar package on unsecure cluster, and rpm package on secure cluster. Thanks, Thejas On 4/20/12 12:39 AM, Daniel Dai wrote: Hi, I have created a candidate build for Pig 0.10.0. Keys used to

[jira] [Created] (PIG-2666) LoadFunc.setLocation() is not called when pig script only has Order By

Francis Liu created PIG-2666: Summary: LoadFunc.setLocation() is not called when pig script only has Order By Key: PIG-2666 URL: https://issues.apache.org/jira/browse/PIG-2666 Project: Pig Issue

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

Since that's not a regression, this shouldn't block 0.10.0 (but we should fix it). Protip: if you attach a patch as a file , click the "grant apache license" while uploading, and then hit "patch available", it will show up on our filters as an issue that has an available patch, and this will be mo

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

I'm working on getting through the unit tests, but should SNAPSHOT still be in the version? $ grep SNAPSHOT build.xml On Tue, Apr 24, 2012 at 8:47 AM, Joseph Adler wrote: > Can you guys please fix https://issues.apache.org/jira/browse/PIG-2266 > > Without that, I can guarantee that AvroSto

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

Can you guys please fix https://issues.apache.org/jira/browse/PIG-2266 Without that, I can guarantee that AvroStorage will fail on large files. On Mon, Apr 23, 2012 at 8:07 PM, Joseph Adler wrote: > I will do it tomorrow on one of my workflows. Could take some trial and error > to get it workin

[jira] [Commented] (PIG-2085) HBaseStorage fails with multiple STORE statements

[ https://issues.apache.org/jira/browse/PIG-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260658#comment-13260658 ] Dmitriy V. Ryaboy commented on PIG-2085: Kevin, This is an HBase bug as described ab

[jira] [Updated] (PIG-2665) Bundled Jython jar in Pig 0.10.0-RC breaks module import in Python scripts with embedded Pig Latin

[ https://issues.apache.org/jira/browse/PIG-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Noll updated PIG-2665: -- Description: Using Pig 0.9.0 I was running into PIG-1824 when using import statements (e.g. {{import os}

[jira] [Commented] (PIG-2085) HBaseStorage fails with multiple STORE statements

[ https://issues.apache.org/jira/browse/PIG-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260483#comment-13260483 ] Kevin Lion commented on PIG-2085: - Using HBase 0.90.3 and Pig 0.9.2 : the bug is still here.

[jira] [Created] (PIG-2665) Bundled Jython jar in Pig 0.10.0-RC breaks module import in Python scripts with embedded Pig Latin

Michael Noll created PIG-2665: - Summary: Bundled Jython jar in Pig 0.10.0-RC breaks module import in Python scripts with embedded Pig Latin Key: PIG-2665 URL: https://issues.apache.org/jira/browse/PIG-2665

[jira] [Updated] (PIG-2665) Bundled Jython jar in Pig 0.10.0-RC breaks module import in Python scripts with embedded Pig Latin

[ https://issues.apache.org/jira/browse/PIG-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Noll updated PIG-2665: -- Description: Using Pig 0.9.0 I was running into PIG-1824 when using import statements (e.g. {{import os}

Build failed in Jenkins: Pig-trunk #1233

See Changes: [billgraham] PIG-2257 - AvroStorage doesn't recognize schema_file field when JSON isn't used in the constructor (billgraham) [billgraham] PIG-2587 - Compute LogicalPlan signature and store in job conf (billgraham) ---

[jira] [Commented] (PIG-2650) Convenience mock Loader and Storer to simplify unit testing of Pig scripts

[ https://issues.apache.org/jira/browse/PIG-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260417#comment-13260417 ] Gianmarco De Francisci Morales commented on PIG-2650: - Tests pass, looks

Re: [Changing subject] Pig setup 0.10.0 vs 0.9.1

You will need either: set HADOOP_HOME, or use -x local On Tue, Apr 24, 2012 at 12:52 AM, Prashant Kommireddi wrote: > Aaah I think that clue helped. This was my setup: > > HADOOP_HOME was set in .bashrc > > In my wrapper script I unset HADOOP_HOME for pig to pick up the bundled > version 0.20.2.

[jira] [Commented] (PIG-2547) Easier UDFs: Convenient EvalFunc super-classes

[ https://issues.apache.org/jira/browse/PIG-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260338#comment-13260338 ] Daniel Dai commented on PIG-2547: - Looks good, couple of comments: 1. TypedOutputEvalFunc: G

[Changing subject] Pig setup 0.10.0 vs 0.9.1

Aaah I think that clue helped. This was my setup: HADOOP_HOME was set in .bashrc In my wrapper script I unset HADOOP_HOME for pig to pick up the bundled version 0.20.2. This works for 0.9.1. 0.10.0 however picks up HADOOP_HOME though I unset it in my wrapper script. Ofcourse, it worked after rem

[jira] [Commented] (PIG-2652) Skew join and order by don't trigger reducer estimation

[ https://issues.apache.org/jira/browse/PIG-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13260309#comment-13260309 ] Daniel Dai commented on PIG-2652: - Yes, I will run the test. > Skew join an

Re: [VOTE] Release Pig 0.10.0 (candidate 0)

Do you have HADOOP_HOME? Both HADOOP_CONF_DIR/PIG_CLASSPATH should work, can you use bin/pig -secretDebugCmd to check hadoop command line? On Mon, Apr 23, 2012 at 11:32 PM, Prashant Kommireddi wrote: > Thanks Dmitriy, that works. But I am wondering why the behavior is > different from the previou

(changing subj) pig picking up hadoop-env.sh

Pig gets started using the hadoop command when one is available, so you'd expect it to do what the hadoop command does in your environment. Keeps env management sane... D On Mon, Apr 23, 2012 at 11:32 PM, Prashant Kommireddi wrote: > Thanks Dmitriy, that works. But I am wondering why the behavi

[jira] [Updated] (PIG-2257) AvroStorage doesn't recognize schema_file field when JSON isn't used in the constructor

[ https://issues.apache.org/jira/browse/PIG-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-2257: - Resolution: Fixed Fix Version/s: 0.11 Status: Resolved (was: Patch Available) > Avro