[jira] [Commented] (PIG-1916) Nested cross

[ https://issues.apache.org/jira/browse/PIG-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016720#comment-13016720 ] Zhijie Shen commented on PIG-1916: -- Here is the draft of my GSoC'11 application for the thi

[jira] [Updated] (PIG-1975) Need to provide backward compatibility for legacy LoadCaster (without bytesToMap(bytes, fieldSchema))

[ https://issues.apache.org/jira/browse/PIG-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1975: Attachment: PIG-1975-1.patch No test added since it is impossible to make legacy LoadCaster compile in new c

[jira] [Created] (PIG-1975) Need to provide backward compatibility for legacy LoadCaster (without bytesToMap(bytes, fieldSchema))

Need to provide backward compatibility for legacy LoadCaster (without bytesToMap(bytes, fieldSchema)) - Key: PIG-1975 URL: https://issues.apache.org/jira/browse/PI

[jira] [Commented] (PIG-1974) Lineage need to set for every cast

[ https://issues.apache.org/jira/browse/PIG-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016705#comment-13016705 ] Daniel Dai commented on PIG-1974: - The issue is because lineage only set caster if the input

[jira] [Created] (PIG-1974) Lineage need to set for every cast

Lineage need to set for every cast -- Key: PIG-1974 URL: https://issues.apache.org/jira/browse/PIG-1974 Project: Pig Issue Type: Bug Components: impl Affects Versions: 0.9.0 Reporter:

[jira] [Updated] (PIG-1973) UDFContext.getUDFContext has a thread race condition around it's ThreadLocal

[ https://issues.apache.org/jira/browse/PIG-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Woody Anderson updated PIG-1973: Attachment: 1973.patch use the initialValue method of ThreadLocal, which is how to correctly handle

[jira] [Created] (PIG-1973) UDFContext.getUDFContext has a thread race condition around it's ThreadLocal

UDFContext.getUDFContext has a thread race condition around it's ThreadLocal Key: PIG-1973 URL: https://issues.apache.org/jira/browse/PIG-1973 Project: Pig Issue Ty

[jira] [Created] (PIG-1972) Cache split information details for data with large number of small part files

Cache split information details for data with large number of small part files -- Key: PIG-1972 URL: https://issues.apache.org/jira/browse/PIG-1972 Project: Pig Issu

[jira] [Updated] (PIG-1971) New Logical Plan messes up schemas in projections

[ https://issues.apache.org/jira/browse/PIG-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-1971: --- Description: While dealing with PIG-1870, I found that when using the HBaseStorage load/storef

[jira] [Created] (PIG-1971) New Logical Plan messes up schemas in projections

New Logical Plan messes up schemas in projections - Key: PIG-1971 URL: https://issues.apache.org/jira/browse/PIG-1971 Project: Pig Issue Type: Bug Affects Versions: 0.8.0 Report

[jira] [Created] (PIG-1970) Relax the condition to find output/input dependency

Relax the condition to find output/input dependency --- Key: PIG-1970 URL: https://issues.apache.org/jira/browse/PIG-1970 Project: Pig Issue Type: Improvement Reporter: Daniel Dai

[jira] [Commented] (PIG-1584) deal with inner cogroup

[ https://issues.apache.org/jira/browse/PIG-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016639#comment-13016639 ] Olga Natkovich commented on PIG-1584: - It looks like we already do not mention inner or

[jira] [Commented] (PIG-1777) LoadFunc in a scripting language

[ https://issues.apache.org/jira/browse/PIG-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016637#comment-13016637 ] Alan Gates commented on PIG-1777: - +1 for delaying this. I'd like to get it done but I won'

Next Pig Developer Meeting

Hi guys, It has been a while and I think we have a few topics to discuss. Here are the ones I would like to propose : (1)What is the process and criteria for changing existing releases. For instance, which changes are ok for existing branches vs. which ones should go to the trunk or to an

[jira] [Created] (PIG-1969) Typechecking warnings are no longer displayed

Typechecking warnings are no longer displayed - Key: PIG-1969 URL: https://issues.apache.org/jira/browse/PIG-1969 Project: Pig Issue Type: Bug Reporter: Olga Natkovich Assig

[jira] [Updated] (PIG-1824) Support import modules in Jython UDF

[ https://issues.apache.org/jira/browse/PIG-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1824: Fix Version/s: (was: 0.10) (was: 0.8.0) > Support import modules in Jython

[jira] [Assigned] (PIG-1873) Pig try to interpret UDF as Macro

[ https://issues.apache.org/jira/browse/PIG-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1873: --- Assignee: Corinne Chandel (was: Richard Ding) Corinne, we need to add a note to both MACRO doc

Build failed in Jenkins: Pig-trunk #970

See Changes: [julien] PIG-1923 Map of primitive types in Python and PIG-1944 javascript register udfs [daijy] Fix checkstyle target [rding] PIG-1955: PhysicalOperator has a member variable (non-static) Log object that is non-transie

Build failed in Jenkins: Pig-trunk-commit #731

See Changes: [julien] PIG-1923 Map of primitive types in Python and PIG-1944 javascript register udfs [daijy] Fix checkstyle target -- [...truncated 36196 lines...] [junit] (10:LOLoa

[jira] [Resolved] (PIG-1923) Jython UDFs fail to convert Maps of Integer values back to Pig types

[ https://issues.apache.org/jira/browse/PIG-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved PIG-1923. Resolution: Fixed committed in TRUNK > Jython UDFs fail to convert Maps of Integer values back to Pi

[jira] [Resolved] (PIG-1944) register javascript UDFs does not work

[ https://issues.apache.org/jira/browse/PIG-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved PIG-1944. Resolution: Fixed committed in TRUNK > register javascript UDFs does not work > ---

[jira] [Updated] (PIG-1942) script UDF (jython) should utilize the intended output schema to more directly convert Py objects to Pig objects

[ https://issues.apache.org/jira/browse/PIG-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1942: Fix Version/s: (was: 0.9.0) 0.10 > script UDF (jython) should utilize the inte

[jira] [Assigned] (PIG-1871) Dont throw exception if partition filters cannot be pushed up.

[ https://issues.apache.org/jira/browse/PIG-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1871: --- Assignee: Richard Ding > Dont throw exception if partition filters cannot be pushed up. > ---

[jira] [Updated] (PIG-1967) deprecate current syntax for casting relation as scalar, to use explicit cast to tuple

[ https://issues.apache.org/jira/browse/PIG-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1967: Fix Version/s: (was: 0.9.0) 0.10 Delaying till 10 since we do not have an alte

[jira] [Assigned] (PIG-1811) Provide a way to access properties defined in properties file in front end

[ https://issues.apache.org/jira/browse/PIG-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1811: --- Assignee: Richard Ding > Provide a way to access properties defined in properties file in front

[jira] [Assigned] (PIG-1866) Dereference a bag within a tuple does not work

[ https://issues.apache.org/jira/browse/PIG-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1866: --- Assignee: Richard Ding > Dereference a bag within a tuple does not work > -

[jira] [Assigned] (PIG-1702) Streaming debug output outputs null input-split information

[ https://issues.apache.org/jira/browse/PIG-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1702: --- Assignee: Adam Warrington > Streaming debug output outputs null input-split information > -

[jira] [Resolved] (PIG-1931) Integrate Macro Expansion with New Parser

[ https://issues.apache.org/jira/browse/PIG-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding resolved PIG-1931. --- Resolution: Fixed Hadoop Flags: [Reviewed] patches are committed to trunk. > Integrate Macro Exp

[jira] [Assigned] (PIG-536) the shell script 'pig' does not work if PIG_HOME has the word 'hadoop' in it's directory, and pig script is missing in the types branch

[ https://issues.apache.org/jira/browse/PIG-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-536: -- Assignee: Michael Noll (was: Olga Natkovich) > the shell script 'pig' does not work if PIG_HOME h

[jira] [Updated] (PIG-1930) comparison operation 'null == null' should evaluate to null

[ https://issues.apache.org/jira/browse/PIG-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1930: Fix Version/s: (was: 0.9.0) > comparison operation 'null == null' should evaluate to null >

[jira] [Updated] (PIG-1930) comparison operation 'null == null' should evaluate to null

[ https://issues.apache.org/jira/browse/PIG-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1930: Fix Version/s: 0.10 > comparison operation 'null == null' should evaluate to null >

[jira] [Assigned] (PIG-536) the shell script 'pig' does not work if PIG_HOME has the word 'hadoop' in it's directory, and pig script is missing in the types branch

[ https://issues.apache.org/jira/browse/PIG-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-536: -- Assignee: Olga Natkovich > the shell script 'pig' does not work if PIG_HOME has the word 'hadoop'

[jira] [Updated] (PIG-1919) order-by on bag gives error only at runtime

[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1919: Fix Version/s: (was: 0.9.0) > order-by on bag gives error only at runtime > -

[jira] [Updated] (PIG-1919) order-by on bag gives error only at runtime

[ https://issues.apache.org/jira/browse/PIG-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1919: Fix Version/s: 0.10 > order-by on bag gives error only at runtime > -

[jira] [Updated] (PIG-1865) BinStorage/PigStorageSchema cannot load data from a different namenode

[ https://issues.apache.org/jira/browse/PIG-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1865: Fix Version/s: (was: 0.8.0) Assignee: Daniel Dai > BinStorage/PigStorageSchema cannot lo

[jira] [Updated] (PIG-438) Handle realiasing of existing Alias (A=B;)

[ https://issues.apache.org/jira/browse/PIG-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-438: --- Fix Version/s: (was: 0.9.0) > Handle realiasing of existing Alias (A=B;) >

[jira] [Updated] (PIG-1907) replace use of TupleFactory.newTupleNoCopy(List) with newTuple(List) in some of the physical operators

[ https://issues.apache.org/jira/browse/PIG-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1907: Fix Version/s: (was: 0.9.0) 0.10 > replace use of TupleFactory.newTupleNoCopy(

[jira] [Updated] (PIG-583) Bag constants used in non foreach statements cause lexical errors

[ https://issues.apache.org/jira/browse/PIG-583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-583: --- Fix Version/s: (was: 0.9.0) > Bag constants used in non foreach statements cause lexical errors > --

[jira] [Updated] (PIG-438) Handle realiasing of existing Alias (A=B;)

[ https://issues.apache.org/jira/browse/PIG-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-438: --- Fix Version/s: 0.10 > Handle realiasing of existing Alias (A=B;) >

[jira] [Resolved] (PIG-1247) Error Number makes it hard to debug: ERROR 2999: Unexpected internal error. org.apache.pig.backend.datastorage.DataStorageException cannot be cast to java.lang.Error

[ https://issues.apache.org/jira/browse/PIG-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich resolved PIG-1247. - Resolution: Fixed I could not reproduce the issue with the latest code. Please, re-open if this is

[jira] [Updated] (PIG-1339) International characters in column names not supported

[ https://issues.apache.org/jira/browse/PIG-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1339: Fix Version/s: (was: 0.9.0) 0.10 delaying till next release > International c

[jira] [Updated] (PIG-1345) Link casting errors in POCast to actual lines numbers in Pig script

[ https://issues.apache.org/jira/browse/PIG-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1345: Fix Version/s: (was: 0.9.0) 0.10 delaying till 0.10 > Link casting errors in

[jira] [Commented] (PIG-1931) Integrate Macro Expansion with New Parser

[ https://issues.apache.org/jira/browse/PIG-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016538#comment-13016538 ] Olga Natkovich commented on PIG-1931: - Can this ticket be closed? > Integrate Macro Exp

[jira] [Commented] (PIG-1918) Line number should be give for logical plan failures

[ https://issues.apache.org/jira/browse/PIG-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016537#comment-13016537 ] Thejas M Nair commented on PIG-1918: PIG-1918-4.patch review- The following constructor

[jira] [Updated] (PIG-1883) Pig's progress estimation should account for parallel job executions

[ https://issues.apache.org/jira/browse/PIG-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1883: Fix Version/s: (was: 0.9.0) > Pig's progress estimation should account for parallel job execution

[jira] [Commented] (PIG-1944) register javascript UDFs does not work

[ https://issues.apache.org/jira/browse/PIG-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016534#comment-13016534 ] Olga Natkovich commented on PIG-1944: - Julien, are you ready to commit this patch? > re

[jira] [Commented] (PIG-1777) LoadFunc in a scripting language

[ https://issues.apache.org/jira/browse/PIG-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016532#comment-13016532 ] Olga Natkovich commented on PIG-1777: - Alan and John - are you still working on this and

[jira] [Commented] (PIG-1923) Jython UDFs fail to convert Maps of Integer values back to Pig types

[ https://issues.apache.org/jira/browse/PIG-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016533#comment-13016533 ] Olga Natkovich commented on PIG-1923: - Julien, are you ready to commit this patch? > Jy

[jira] [Updated] (PIG-1810) Prioritize hadoop parameter "mapred.reduce.task" above estimation of reducer number

[ https://issues.apache.org/jira/browse/PIG-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1810: Fix Version/s: (was: 0.9.0) Unlinking from the release since there is no activity and it is too l

[jira] [Updated] (PIG-259) allow store to overwrite existing directroy

[ https://issues.apache.org/jira/browse/PIG-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-259: --- Fix Version/s: (was: 0.9.0) Unlinking from the release since there is no activities and we are movin

[jira] [Updated] (PIG-1150) VAR() Variance UDF

[ https://issues.apache.org/jira/browse/PIG-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1150: Fix Version/s: (was: 0.9.0) Unlinking from the release because there is not much activity on the

[jira] [Updated] (PIG-1565) additional piggybank datetime and string UDFs

[ https://issues.apache.org/jira/browse/PIG-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1565: Fix Version/s: (was: 0.9.0) I don't see any activity on this issue since the last release. Given

[jira] [Created] (PIG-1968) Need to document embeding in Java

Need to document embeding in Java - Key: PIG-1968 URL: https://issues.apache.org/jira/browse/PIG-1968 Project: Pig Issue Type: Bug Components: documentation Reporter: Olga Natkovich

[jira] [Created] (PIG-1967) deprecate current syntax for casting relation as scalar, to use explicit cast to tuple

deprecate current syntax for casting relation as scalar, to use explicit cast to tuple -- Key: PIG-1967 URL: https://issues.apache.org/jira/browse/PIG-1967 Project: P

[jira] [Commented] (PIG-1824) Support import modules in Jython UDF

[ https://issues.apache.org/jira/browse/PIG-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016475#comment-13016475 ] Alan Gates commented on PIG-1824: - A couple of questions: # Based on my analysis the static

[jira] [Resolved] (PIG-1966) Document Store and load from the same location does not support globbing

[ https://issues.apache.org/jira/browse/PIG-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich resolved PIG-1966. - Resolution: Invalid The necessary information is already documented and includes an example. Pleas

[jira] [Resolved] (PIG-1955) PhysicalOperator has a member variable (non-static) Log object that is non-transient, this causes serialization errors

[ https://issues.apache.org/jira/browse/PIG-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding resolved PIG-1955. --- Resolution: Fixed Fix Version/s: (was: 0.8.0) Hadoop Flags: [Reviewed] Patch committed

[jira] [Commented] (PIG-1955) PhysicalOperator has a member variable (non-static) Log object that is non-transient, this causes serialization errors

[ https://issues.apache.org/jira/browse/PIG-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016434#comment-13016434 ] Richard Ding commented on PIG-1955: --- Test-patch result: {code} [exec] -1 overall.

[jira] [Updated] (PIG-1911) Infinite loop with accumulator function in nested foreach

[ https://issues.apache.org/jira/browse/PIG-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-1911: --- Attachment: PIG-1911.trunk.1.patch > Infinite loop with accumulator function in nested foreach > --

[jira] [Resolved] (PIG-1964) PigStorageSchema fails if a column value is null

[ https://issues.apache.org/jira/browse/PIG-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair resolved PIG-1964. Resolution: Fixed Hadoop Flags: [Reviewed] piggybank unit tests and test-patch passed. Patch co

Re: How to group on a group id that is present inside a complex hierarchy

Approach 2 should work except for a bug in the way flatten schemas are handled (the bug will be fixed in 0.9 fwiw). If you specify the schema after the flatten I think it will work. Change at = foreach inputTuples generate flatten($0.$0#'stdout'); to at = foreach inputTuples generate flat

Issue with testing pig scripts using PIGUNIT

Hi, I have set up a unit test for a sample pig script I getting the following as the error dump which might be caused due to the problem with the *pig.jar *. Please let me know where can I get a proper *pig.jar* to download currently using *pig-0.7.0-core.jar, *which is a requirement in the* PIGU