[jira] [Commented] (PIG-3126) Problem in STORE

[ https://issues.apache.org/jira/browse/PIG-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560396#comment-13560396 ] Vishnu Ganth commented on PIG-3126: --- Hadoop 2.0.0 > Problem in STORE > --

[jira] [Commented] (PIG-3005) TestLargeFile#testOrderBy is failing

[ https://issues.apache.org/jira/browse/PIG-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560330#comment-13560330 ] Rohini Palaniswamy commented on PIG-3005: - bq. I think we can close this as the test

[jira] [Commented] (PIG-3071) update hcatalog jar and path to hbase storage handler jar in pig script

[ https://issues.apache.org/jira/browse/PIG-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560326#comment-13560326 ] Rohini Palaniswamy commented on PIG-3071: - Yes it should be picked from hive-site.xm

[jira] [Commented] (PIG-3071) update hcatalog jar and path to hbase storage handler jar in pig script

[ https://issues.apache.org/jira/browse/PIG-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560315#comment-13560315 ] Roman Shaposhnik commented on PIG-3071: --- Guys, this is extremely useful! Question thou

[jira] [Commented] (PIG-3124) Push FLATTENs After FILTERs If Possible

[ https://issues.apache.org/jira/browse/PIG-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560304#comment-13560304 ] Nick White commented on PIG-3124: - Indeed - Daniel pointed out the code changes weren't nece

[jira] [Created] (PIG-3135) HExecutionEngine should look for resources in user passed Properties

Prashant Kommireddi created PIG-3135: Summary: HExecutionEngine should look for resources in user passed Properties Key: PIG-3135 URL: https://issues.apache.org/jira/browse/PIG-3135 Project: Pig

[jira] [Created] (PIG-3134) Allow support for hot-pluggable Script Engines for running embedded Pig

Connor Woodson created PIG-3134: --- Summary: Allow support for hot-pluggable Script Engines for running embedded Pig Key: PIG-3134 URL: https://issues.apache.org/jira/browse/PIG-3134 Project: Pig

Re: Custom Scripting Engine

There are two ways to go about using R with java (that I've found). Both are a little bit of a hassle depending on your setup. JRI is a JNI for R, so you don't need R installed on the machine for it to work. But you do need to include a set of DLLs in the classpath; the best way I've found to do t

[jira] Subscription: PIG patch available

Issue Subscription Filter: PIG patch available (33 issues) Subscriber: pigdaily Key Summary PIG-3124Push FLATTENs After FILTERs If Possible https://issues.apache.org/jira/browse/PIG-3124 PIG-3123Simplify Logical Plans By Removing Unneccessary Identity Projectio

[jira] [Created] (PIG-3133) Revamp algebraic interface to actually return classes

Jonathan Coveney created PIG-3133: - Summary: Revamp algebraic interface to actually return classes Key: PIG-3133 URL: https://issues.apache.org/jira/browse/PIG-3133 Project: Pig Issue Type: I

[jira] [Commented] (PIG-3124) Push FLATTENs After FILTERs If Possible

[ https://issues.apache.org/jira/browse/PIG-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560250#comment-13560250 ] Daniel Dai commented on PIG-3124: - Nick added a test case and some comments, but remove the

Re: Custom Scripting Engine

Ahhh, I see. That makes sense. Sadly, this won't currently be possible in the current version of Pig, but this is a really good reason to want to do this. Can you make a ticket about making it possible to plug in ScriptingEngines without having a make a code change to Pig? I think this would be use

[jira] [Commented] (PIG-3124) Push FLATTENs After FILTERs If Possible

[ https://issues.apache.org/jira/browse/PIG-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560244#comment-13560244 ] Jonathan Coveney commented on PIG-3124: --- Nick, The new patch does not include a lot o

[jira] [Resolved] (PIG-2972) Umbrella ticket for test failures in 0.11/trunk

[ https://issues.apache.org/jira/browse/PIG-2972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-2972. Resolution: Fixed Closing it since all sub-tasks are resolved or moved out of 0.11.

[jira] [Commented] (PIG-2846) Can we skip hcat related e2e when hcat is not installed?

[ https://issues.apache.org/jira/browse/PIG-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560219#comment-13560219 ] Cheolsoo Park commented on PIG-2846: Hi Julien, yes, I just did. > Can

[jira] [Updated] (PIG-2846) Can we skip hcat related e2e when hcat is not installed?

[ https://issues.apache.org/jira/browse/PIG-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2846: --- Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-2972) > Can we skip hcat rel

[jira] [Updated] (PIG-3010) Allow UDF's to flatten themselves

[ https://issues.apache.org/jira/browse/PIG-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-3010: -- Attachment: PIG-3010-3.patch PIG-3010-3_nows.patch I went ahead and made a review

Re: Custom Scripting Engine

I'm starting work on an R scripting engine; I'm not entirely sure how it will be used, but I know that there have been attempts to get R working with MapReduce / EMR and I thought it would be cool to do that through Pig. (One fun use case might be to generate plots/graphs during the MR job (then do

Review Request: Allow UDFs to flatten themselves

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9060/ --- Review request for pig. Description --- see PIG-3010 Diffs - src/

[jira] [Resolved] (PIG-3091) Make schema, header and stats file configurable in JsonMetadata

[ https://issues.apache.org/jira/browse/PIG-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney resolved PIG-3091. --- Resolution: Fixed Committed. Thanks, Prashant! > Make schema, header and stats

Re: Custom Scripting Engine

So, something like this is not currently possible, but I think it would be possible to expose a set of interfaces that would make this possible. That said, why is this desirable? Is your goal to override one of the existing SE's, or something? I could imagine reworking things so that anyone can reg

[jira] [Updated] (PIG-3005) TestLargeFile#testOrderBy is failing

[ https://issues.apache.org/jira/browse/PIG-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3005: --- Issue Type: Bug (was: Sub-task) Parent: (was: PIG-2972) > TestLargeFile#testOrderBy is

[jira] [Commented] (PIG-2846) Can we skip hcat related e2e when hcat is not installed?

[ https://issues.apache.org/jira/browse/PIG-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560184#comment-13560184 ] Julien Le Dem commented on PIG-2846: Hey [~cheolsoo] should we detach this from Pig 0.11

[jira] [Updated] (PIG-3105) Fix TestJobSubmission unit test failure.

[ https://issues.apache.org/jira/browse/PIG-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-3105: --- Fix Version/s: (was: 0.11) 0.12 I'm moving this to the next release as it does n

[jira] [Updated] (PIG-3078) Make a UDF that, given a string, returns just the columns prefixed by that string

[ https://issues.apache.org/jira/browse/PIG-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-3078: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Make a UDF that, given a

[jira] [Commented] (PIG-3091) Make schema, header and stats file configurable in JsonMetadata

[ https://issues.apache.org/jira/browse/PIG-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560163#comment-13560163 ] Jonathan Coveney commented on PIG-3091: --- +1. I'll commit shortly. > M

[jira] [Commented] (PIG-3078) Make a UDF that, given a string, returns just the columns prefixed by that string

[ https://issues.apache.org/jira/browse/PIG-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560153#comment-13560153 ] Daniel Dai commented on PIG-3078: - +1 > Make a UDF that, given a string, re

[jira] [Updated] (PIG-3091) Make schema, header and stats file configurable in JsonMetadata

[ https://issues.apache.org/jira/browse/PIG-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-3091: - Attachment: PIG-3091_2.patch Jon, ready for your review! > Make schema, he

[jira] [Updated] (PIG-3090) Introduce a syntax to be able to easily refer to the previously defined relation

[ https://issues.apache.org/jira/browse/PIG-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-3090: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Introduce a syntax to be

[jira] [Commented] (PIG-3114) Duplicated macro name error when using pigunit

[ https://issues.apache.org/jira/browse/PIG-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560148#comment-13560148 ] Daniel Dai commented on PIG-3114: - Looks good. Would you mind add a unit test case?

[jira] [Updated] (PIG-3114) Duplicated macro name error when using pigunit

[ https://issues.apache.org/jira/browse/PIG-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3114: Assignee: Chetan Nadgire > Duplicated macro name error when using pigunit > -

[jira] [Commented] (PIG-3091) Make schema, header and stats file configurable in JsonMetadata

[ https://issues.apache.org/jira/browse/PIG-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560143#comment-13560143 ] Prashant Kommireddi commented on PIG-3091: -- That makes sense, will add a new patch.

[jira] [Commented] (PIG-2553) Pig shouldn't allow attempts to write multiple relations into same directory

[ https://issues.apache.org/jira/browse/PIG-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560142#comment-13560142 ] Prashant Kommireddi commented on PIG-2553: -- Hey Cheolsoo, been out on vacation all

[jira] [Commented] (PIG-3132) NPE when illustrating a relation with HCatLoader

[ https://issues.apache.org/jira/browse/PIG-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560140#comment-13560140 ] Daniel Dai commented on PIG-3132: - There are multiple root causes: 1. There is no distinguis

[jira] [Updated] (PIG-3132) NPE when illustrating a relation with HCatLoader

[ https://issues.apache.org/jira/browse/PIG-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3132: Attachment: PIG-3132-1.patch > NPE when illustrating a relation with HCatLoader > --

[jira] [Commented] (PIG-3078) Make a UDF that, given a string, returns just the columns prefixed by that string

[ https://issues.apache.org/jira/browse/PIG-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560135#comment-13560135 ] Jonathan Coveney commented on PIG-3078: --- Made a doc jira. Will commit. Note: I think

[jira] [Created] (PIG-3132) NPE when illustrating a relation with HCatLoader

Daniel Dai created PIG-3132: --- Summary: NPE when illustrating a relation with HCatLoader Key: PIG-3132 URL: https://issues.apache.org/jira/browse/PIG-3132 Project: Pig Issue Type: Bug R

[jira] [Created] (PIG-3131) Document PluckTuple UDF

Jonathan Coveney created PIG-3131: - Summary: Document PluckTuple UDF Key: PIG-3131 URL: https://issues.apache.org/jira/browse/PIG-3131 Project: Pig Issue Type: Task Affects Versions: 0.12

[jira] [Commented] (PIG-3078) Make a UDF that, given a string, returns just the columns prefixed by that string

[ https://issues.apache.org/jira/browse/PIG-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560128#comment-13560128 ] Daniel Dai commented on PIG-3078: - +1. Need some document (in addition to javadoc) though.

[jira] [Created] (PIG-3130) Support for nested projections

Uri Laserson created PIG-3130: - Summary: Support for nested projections Key: PIG-3130 URL: https://issues.apache.org/jira/browse/PIG-3130 Project: Pig Issue Type: Improvement Components

[jira] [Created] (PIG-3129) Document syntax to refer to previous relation

Jonathan Coveney created PIG-3129: - Summary: Document syntax to refer to previous relation Key: PIG-3129 URL: https://issues.apache.org/jira/browse/PIG-3129 Project: Pig Issue Type: Task

[jira] [Commented] (PIG-3090) Introduce a syntax to be able to easily refer to the previously defined relation

[ https://issues.apache.org/jira/browse/PIG-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560112#comment-13560112 ] Cheolsoo Park commented on PIG-3090: +1. I am comfortable with opening a blocker jira f

[jira] [Updated] (PIG-2764) Add a biginteger and bigdecimal type to pig

[ https://issues.apache.org/jira/browse/PIG-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2764: -- Attachment: PIG-2764-5.patch Updated RB, and attaching here. > Add a biginteger

[jira] [Updated] (PIG-2764) Add a biginteger and bigdecimal type to pig

[ https://issues.apache.org/jira/browse/PIG-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2764: -- Fix Version/s: 0.12 Status: Patch Available (was: Open) > Add a biginteger and bi

Re: Review Request: Add BigInteger and BigDecimal to Pig

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9012/#review15588 --- Ship it! LGTM - Mathias Herberts On Jan. 22, 2013, 10:05 p.m., Jo

Re: Review Request: Add BigInteger and BigDecimal to Pig

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9012/#review15587 --- Ship it! LGTM - Mathias Herberts On Jan. 22, 2013, 10:05 p.m., Jo

Re: Review Request: Add BigInteger and BigDecimal to Pig

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9012/ --- (Updated Jan. 22, 2013, 10:05 p.m.) Review request for pig, Alan Gates and Mathi

[jira] [Commented] (PIG-3090) Introduce a syntax to be able to easily refer to the previously defined relation

[ https://issues.apache.org/jira/browse/PIG-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560084#comment-13560084 ] Jonathan Coveney commented on PIG-3090: --- +1's welcome. :) Cheolsoo, are you comfortab

[jira] [Commented] (PIG-3126) Problem in STORE

[ https://issues.apache.org/jira/browse/PIG-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560049#comment-13560049 ] Daniel Dai commented on PIG-3126: - Which version of Hadoop are you using? >

[jira] [Commented] (PIG-3090) Introduce a syntax to be able to easily refer to the previously defined relation

[ https://issues.apache.org/jira/browse/PIG-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560044#comment-13560044 ] Daniel Dai commented on PIG-3090: - I am fine to do it progressively. We can create another i

[jira] [Commented] (PIG-3090) Introduce a syntax to be able to easily refer to the previously defined relation

[ https://issues.apache.org/jira/browse/PIG-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559946#comment-13559946 ] Cheolsoo Park commented on PIG-3090: Hi Jonathan, I am fine as long as it's well-documen

[jira] [Commented] (PIG-3105) Fix TestJobSubmission unit test failure.

[ https://issues.apache.org/jira/browse/PIG-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559933#comment-13559933 ] Vikram Dixit K commented on PIG-3105: - The related HBase issue was committed earlier thi

[jira] [Commented] (PIG-2764) Add a biginteger and bigdecimal type to pig

[ https://issues.apache.org/jira/browse/PIG-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559921#comment-13559921 ] Jonathan Coveney commented on PIG-2764: --- PS thanks to Alan, Matthias, and Cheolsoo for

[jira] [Commented] (PIG-2764) Add a biginteger and bigdecimal type to pig

[ https://issues.apache.org/jira/browse/PIG-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559918#comment-13559918 ] Jonathan Coveney commented on PIG-2764: --- Good comments all around. I just responded an

Re: Review Request: Add BigInteger and BigDecimal to Pig

> On Jan. 19, 2013, 7:29 p.m., Mathias Herberts wrote: > > src/org/apache/pig/data/DefaultTuple.java, line 359 > > > > > > Since BigDecimal have a scale which is an int, nothing prevents a > > BigDecimal to have a sc

Re: Review Request: Add BigInteger and BigDecimal to Pig

> On Jan. 21, 2013, 6:27 p.m., Alan Gates wrote: > > src/org/apache/pig/backend/hadoop/hbase/HBaseBinaryConverter.java, line 192 > > > > > > Is this because HBase doesn't have a standard representation for this? Yes, t

[jira] [Commented] (PIG-3031) Update Pig to use a newer version of joda-time

[ https://issues.apache.org/jira/browse/PIG-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559871#comment-13559871 ] Jonathan Coveney commented on PIG-3031: --- Sounds good, thanks y'all. >

[jira] [Created] (PIG-3128) Document the BigInteger and BigDecimal data type

Jonathan Coveney created PIG-3128: - Summary: Document the BigInteger and BigDecimal data type Key: PIG-3128 URL: https://issues.apache.org/jira/browse/PIG-3128 Project: Pig Issue Type: Task

[jira] [Created] (PIG-3127) Add e2e testing for BigInteger and BigDecimal data type

Jonathan Coveney created PIG-3127: - Summary: Add e2e testing for BigInteger and BigDecimal data type Key: PIG-3127 URL: https://issues.apache.org/jira/browse/PIG-3127 Project: Pig Issue Type:

[jira] [Commented] (PIG-3090) Introduce a syntax to be able to easily refer to the previously defined relation

[ https://issues.apache.org/jira/browse/PIG-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559851#comment-13559851 ] Jonathan Coveney commented on PIG-3090: --- Daniel, I think that that is a good idea, bu

[jira] [Commented] (PIG-3005) TestLargeFile#testOrderBy is failing

[ https://issues.apache.org/jira/browse/PIG-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559848#comment-13559848 ] Jonathan Coveney commented on PIG-3005: --- Why is the test excluded? Is it because it's

[jira] [Updated] (PIG-3126) Problem in STORE

[ https://issues.apache.org/jira/browse/PIG-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishnu Ganth updated PIG-3126: -- Summary: Problem in STORE (was: Permission issue in Pig 0.9.2) > Problem in STORE >

[jira] [Updated] (PIG-3126) Permission issue in Pig 0.9.2

[ https://issues.apache.org/jira/browse/PIG-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishnu Ganth updated PIG-3126: -- Attachment: log.txt > Permission issue in Pig 0.9.2 > - > >

[jira] [Created] (PIG-3126) Permission issue in Pig 0.9.2

Vishnu Ganth created PIG-3126: - Summary: Permission issue in Pig 0.9.2 Key: PIG-3126 URL: https://issues.apache.org/jira/browse/PIG-3126 Project: Pig Issue Type: Bug Components: impl

[jira] [Commented] (PIG-3057) Make PigStorage.readField() protected

[ https://issues.apache.org/jira/browse/PIG-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559565#comment-13559565 ] pablo martinez commented on PIG-3057: - thank you ! > Make PigStorag

Jenkins build is back to normal : Pig-trunk #1389

See