[jira] [Commented] (PIG-2563) IndexOutOfBoundsException: while projecting fields from a bag

[ https://issues.apache.org/jira/browse/PIG-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221475#comment-13221475 ] Daniel Dai commented on PIG-2563: - The plan is misformatted: {code} |---C: (Name: LOForE

[jira] [Commented] (PIG-2563) IndexOutOfBoundsException: while projecting fields from a bag

[ https://issues.apache.org/jira/browse/PIG-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221474#comment-13221474 ] Daniel Dai commented on PIG-2563: - Logical plan for the foreach nested plan is wrong. Using

[jira] [Resolved] (PIG-2548) Support for providing parameters to python script

[ https://issues.apache.org/jira/browse/PIG-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-2548. - Resolution: Fixed Release Note: Python script has access to command line arguments with sys.argv.

[jira] [Updated] (PIG-2569) Fix org.apache.pig.test.TestInvoker.testSpeed

[ https://issues.apache.org/jira/browse/PIG-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-2569: -- Description: the Pig unit test org.apache.pig.test.TestInvoker.testSpeed pass sometimes and fail sometim

[jira] [Created] (PIG-2569) Fix org.apache.pig.test.TestInvoker.testSpeed

Fix org.apache.pig.test.TestInvoker.testSpeed - Key: PIG-2569 URL: https://issues.apache.org/jira/browse/PIG-2569 Project: Pig Issue Type: Bug Reporter: Johnny Zhang the Pig unit test

Re: Turn off Speculative Execution in a UDF?

I tried to test turning this off in the setStoreLocation method but without that change I wasn't able to get a job to run with SE happening. As a result I can't verify that the setting is doing anything. Russell, if you can reproduce SE I'd be curious to hear if you could turn it off in setStoreLoc

Re: Is this desirable: relation.projection as sugar for foreach relation generate projection

I should say one operator only do one thing instead. Daniel On Fri, Mar 2, 2012 at 1:48 PM, Dmitriy Ryaboy wrote: > But that's already not the case. The syntax "a = distinct (foreach b > generate  $1, $2);" is completely legal. > > D > > On Fri, Feb 24, 2012 at 2:52 PM, Daniel Dai wrote: >> One

Re: Turn off Speculative Execution in a UDF?

I thought it was too late in the workflow to do this, but it would be really cool if you could. I don't think to think about MapReduce much when I Pig, except to group my scripts by jobs... so this was a surprise for me. Made sense once i thought of it. But it was a surprise. On Fri, Mar 2, 201

Build failed in Jenkins: Pig-trunk #1200

See Changes: [daijy] PIG-2568: PigOutputCommitter hide exception in commitJob -- [...truncated 6626 lines...] [findbugs] org.mozilla.javascript.NativeJavaObject [findbugs] jline.ConsoleReaderInpu

[jira] [Updated] (PIG-2546) build and publish Pig artifacts compiled against Hadoop 0.23

[ https://issues.apache.org/jira/browse/PIG-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated PIG-2546: Fix Version/s: (was: 0.10) 0.9.3 > build and publish Pig artifacts

Re: Turn off Speculative Execution in a UDF?

I was also curious about this and will try it, but my initial thought was that at that point it might be tool late in the workflow of the job. I'll give it a shot and report back. On Fri, Mar 2, 2012 at 1:45 PM, Dmitriy Ryaboy wrote: > In a StoreFunc, you could do that when you get passed the j

Re: Is this desirable: relation.projection as sugar for foreach relation generate projection

But that's already not the case. The syntax "a = distinct (foreach b generate $1, $2);" is completely legal. D On Fri, Feb 24, 2012 at 2:52 PM, Daniel Dai wrote: > One of my concern is that it could complicate GUI mapping for the Pig > script in the future. I feel it might be more clear one sta

Re: Turn off Speculative Execution in a UDF?

In a StoreFunc, you could do that when you get passed the jobconf, right? On Thu, Mar 1, 2012 at 9:37 PM, Bill Graham wrote: > I don't think so. We just do it in the pig script before using the store > func: > > SET mapred.map.tasks.speculative.execution false > > > On Thu, Mar 1, 2012 at 4:19 PM

[jira] [Resolved] (PIG-2568) PigOutputCommitter hide exception in commitJob

[ https://issues.apache.org/jira/browse/PIG-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-2568. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to 0.9/0.10/trunk. > PigOut

[jira] [Commented] (PIG-2317) Ruby/Jruby UDFs

[ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221149#comment-13221149 ] Jonathan Coveney commented on PIG-2317: --- Alan, Does that ticket really apply? It seem

[jira] [Commented] (PIG-2548) Support for providing parameters to python script

[ https://issues.apache.org/jira/browse/PIG-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221121#comment-13221121 ] Alan Gates commented on PIG-2548: - +1. Patch looks good. > Support for pro

[jira] [Commented] (PIG-2317) Ruby/Jruby UDFs

[ https://issues.apache.org/jira/browse/PIG-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221123#comment-13221123 ] Alan Gates commented on PIG-2317: - Once PIG-2548 is checked in we should modify this patch t

[jira] [Commented] (PIG-2568) PigOutputCommitter hide exception in commitJob

[ https://issues.apache.org/jira/browse/PIG-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221115#comment-13221115 ] Alan Gates commented on PIG-2568: - +1. Swallowing exceptions and asserting they shouldn't h

Build failed in Jenkins: Pig-trunk #1199

See Changes: [daijy] PIG-2514: REGEX_EXTRACT not returning correct group with non greedy regex [daijy] PIG-2509: Util.getSchemaFromString fails with java.lang.NullPointerException when a tuple in a bag has no name (as when used in MongoSt

[jira] [Commented] (PIG-2546) build and publish Pig artifacts compiled against Hadoop 0.23

[ https://issues.apache.org/jira/browse/PIG-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220764#comment-13220764 ] Daniel Dai commented on PIG-2546: - Fix version was 0.9.2, since I close 0.9.2 tag, Jira move

[jira] [Commented] (PIG-2555) PigStorageSchema initializes schema and PigContext for every tuple

[ https://issues.apache.org/jira/browse/PIG-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220763#comment-13220763 ] Daniel Dai commented on PIG-2555: - Fix version was 0.9.2, since I close 0.9.2 tag, Jira move

[jira] [Updated] (PIG-2550) Custom tuple results in "Unexpected datatype 110 while reading tuplefrom binary file" while spilling

[ https://issues.apache.org/jira/browse/PIG-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2550: Attachment: PIG-2550-1.patch Vivek, can you try the patch? > Custom tuple results in "Unexpe