date:20110520

[jira] [Created] (PIG-2086) grunt parser fails for: load .. as \n (b:bag{});

2011-05-20 Thread Woody Anderson (JIRA)

grunt parser fails for: load .. as \n (b:bag{}); 
-

 Key: PIG-2086
 URL: https://issues.apache.org/jira/browse/PIG-2086
 Project: Pig
  Issue Type: Bug
  Components: grunt
Affects Versions: 0.10
 Environment: mac 10.5.8
Reporter: Woody Anderson


this snippet fails:
{code}
IN4 = load '$in' using
com.zzz.Storage() as
( inpt:bag{} );
{code}
this works (as on same line as semi-colon)
{code}
IN4 = load '$in' using
com.zzz.Storage()
as ( inpt:bag{} );
{code}

this is the grunt error:
2011-05-20 20:19:34,934 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
1200:   mismatched input ';' expecting 
RIGHT_PAREN

this only happens in cases where the types of the fields are complex e.g. 
bags/tuples
eg. change the type of _inpt_ to be _chararray_ and it will parse.

this is very strange! and i spent hours debugging my schema writing skills and 
reading QueryParser.g before simply trying "as (expr);" on the same line.

_all_ of my scripts had been written with the lines split the other way (with 
lots of ctor args and as-clause elements: hence the line breaks), this is not 
an issue if i don't load complicated types, but it fails in this particular 
case.
This is quite unexpected and seems to be undocumented and a bug imho.
i don't know enough about antlr (i was a javacc person) to make sense of why 
this would be an issue for the parser b/c the grammar looks good assuming 
newline is basically whitespace.

though i can't figure out how newlines are treated in the grammar, there does 
not seem to be a newline routine ala 
https://supportweb.cs.bham.ac.uk/documentation/tutorials/docsystem/build/tutorials/antlr/antlr.html

I'm going to assume the grammar author is much more sophisticated than that 
tutorial and knows how to fix this.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-1772) Pig 090 Documentation

2011-05-20 Thread Corinne Chandel (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Corinne Chandel updated PIG-1772:
-

Attachment: Pig-1772-GA-1.patch

Pig-1772-GA-1 patch

Please apply to trunk and branch-9

Please add pig-index.xml to trunk and branch-9

This patch includes:
> fixes for PIG-2054, 2073, 2068
> updates to UDF, Control Structures (embedded/macros), Tutorial
> misc changes and fixes
> first pass of the Pig index

> Pig 090 Documentation
> -
>
> Key: PIG-1772
> URL: https://issues.apache.org/jira/browse/PIG-1772
> Project: Pig
>  Issue Type: Task
>  Components: documentation
>Affects Versions: 0.9.0
>Reporter: Corinne Chandel
>Assignee: Corinne Chandel
> Fix For: 0.9.0
>
> Attachments: Pig-1772-GA-1.patch, penny-archt.jpg, pig-1772-1.patch, 
> pig-1772-2.patch, pig-1772-3.patch, pig-1772-beta-1-2.patch, 
> pig-1772-beta-1-3.patch, pig-1772-beta-1.patch, pig-1772-beta2-1.patch, 
> pig-1772-beta2-2.patch, pig-index.xml
>
>
> Pig 090 documentation 
> Will include multiple patches as documentation is released with Pig  090 
> milestones (M1, M2, M3, ... )

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-1772) Pig 090 Documentation

2011-05-20 Thread Corinne Chandel (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Corinne Chandel updated PIG-1772:
-

Attachment: pig-index.xml

pig-index.xml

Olga, please add the new index file  (required for the GA-1 patch)

> Pig 090 Documentation
> -
>
> Key: PIG-1772
> URL: https://issues.apache.org/jira/browse/PIG-1772
> Project: Pig
>  Issue Type: Task
>  Components: documentation
>Affects Versions: 0.9.0
>Reporter: Corinne Chandel
>Assignee: Corinne Chandel
> Fix For: 0.9.0
>
> Attachments: penny-archt.jpg, pig-1772-1.patch, pig-1772-2.patch, 
> pig-1772-3.patch, pig-1772-beta-1-2.patch, pig-1772-beta-1-3.patch, 
> pig-1772-beta-1.patch, pig-1772-beta2-1.patch, pig-1772-beta2-2.patch, 
> pig-index.xml
>
>
> Pig 090 documentation 
> Will include multiple patches as documentation is released with Pig  090 
> milestones (M1, M2, M3, ... )

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Pig-trunk #1020

2011-05-20 Thread Apache Jenkins Server

See 

Changes:

[rding] PIG-1824: Support import modules in Jython UDF

[rding] PIG-2081: Dryrun gives wrong line numbers in error message for scripts 
containing macro

--
[...truncated 4234 lines...]
-
| buildJar |   57  |   0   |   0   |   8   ||   50  |   0   |
-
[ivy:retrieve] :: retrieving :: org.apache.pig#Pig
[ivy:retrieve]  confs: [buildJar]
[ivy:retrieve]  1 artifacts copied, 49 already retrieved (288kB/9ms)

buildJar:
 [echo] svnString svn: This client is too old to work with working copy 
'  You need
 [echo] to get a newer Subversion client, or to downgrade this working copy.
 [echo] See http://subversion.tigris.org/faq.html#working-copy-format-change
 [echo] for details.
  [jar] Manifest is invalid: Manifest line "to g" is not valid as it does 
not contain a name and a value separated by ': ' 
  [jar] error while reading original manifest in file: 

 Manifest: null
  [jar] Building jar: 

  [jar] Manifest is invalid: Manifest line "to g" is not valid as it does 
not contain a name and a value separated by ': ' 
  [jar] error while reading original manifest in file: 

 Manifest: null
  [jar] Building jar: 

 [copy] Copying 1 file to 


jarWithOutSvn:

findbugs:
[mkdir] Created dir: 

 [findbugs] Executing findbugs from ant task
 [findbugs] Running FindBugs...
 [findbugs] Exception in thread "main" java.io.IOException: invalid header field
 [findbugs] at java.util.jar.Attributes.read(Attributes.java:389)
 [findbugs] at java.util.jar.Manifest.read(Manifest.java:234)
 [findbugs] at java.util.jar.Manifest.(Manifest.java:52)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.scanJarManifestForClassPathEntries(ClassPathBuilder.java:706)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.processWorkList(ClassPathBuilder.java:580)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.build(ClassPathBuilder.java:195)
 [findbugs] at 
edu.umd.cs.findbugs.FindBugs2.buildClassPath(FindBugs2.java:584)
 [findbugs] at edu.umd.cs.findbugs.FindBugs2.execute(FindBugs2.java:181)
 [findbugs] at edu.umd.cs.findbugs.FindBugs.runMain(FindBugs.java:348)
 [findbugs] at edu.umd.cs.findbugs.FindBugs2.main(FindBugs2.java:1057)
 [findbugs] Java Result: 1
 [findbugs] Output saved to 

 [xslt] Processing 

 to 

 [xslt] Loading stylesheet 
/homes/hudson/tools/findbugs/latest/src/xsl/default.xsl
 [xslt] : Error! Premature end of file.
 [xslt] : Error! 
com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Premature end of 
file.
 [xslt] Failed to process 


BUILD FAILED
javax.xml.transform.TransformerException: 
javax.xml.transform.TransformerException: 
com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Premature end of 
file.
at 
com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:719)
at 
com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313)
at 
org.apache.tools.ant.taskdefs.optional.TraXLiaison.transform(TraXLiaison.java:187)
at 
org.apache.tools.ant.taskdefs.XSLTProcess.process(XSLTProcess.java:709)
at 
org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:333)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
at org.apache.tools.ant.Ta

[jira] [Updated] (PIG-2085) HBaseStorage fails with multiple STORE statements

2011-05-20 Thread Bill Graham (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bill Graham updated PIG-2085:
-

Attachment: PIG-2085_example_input.txt
PIG-2085_schema.hbase
PIG-2085_example_script.pig

Attaching scripts to create the HBase table and to reproduce, along with sample 
input data.

> HBaseStorage fails with multiple STORE statements
> -
>
> Key: PIG-2085
> URL: https://issues.apache.org/jira/browse/PIG-2085
> Project: Pig
>  Issue Type: Bug
>Reporter: Bill Graham
>Assignee: Bill Graham
> Attachments: PIG-2085_example_input.txt, PIG-2085_example_script.pig, 
> PIG-2085_schema.hbase
>
>
> Scripts with multiple STORE statements using HBaseStorage fail when run 
> against a cluster (they succeed in local mode). Below is an example script:
> {code}
> raw = LOAD 'hbase_split_load_bug.txt' AS
>   (f1: chararray, f2:chararray);
> SPLIT raw INTO apples IF (f2 == 'apple'), oranges IF (f2 == 'orange');
> STORE apples INTO 'hbase://test_table'
>USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:apple');
> STORE oranges INTO 'hbase://test_table'
>USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:orange');
> {code}
> The server throws the following exception after {{apples}} is successfully 
> stored:
> {code}
> Backend error message
> -
> java.io.IOException: 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@6273305c
>  closed
> at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:566)
> at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1113)
> at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatchOfPuts(HConnectionManager.java:1233)
> at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:819)
> at 
> org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.close(TableOutputFormat.java:106)
> at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReducePOStoreImpl.tearDown(MapReducePOStoreImpl.java:96)
> at 
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.tearDown(POStore.java:122)
> at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.cleanup(PigMapBase.java:128)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (PIG-2085) HBaseStorage fails with multiple STORE statements

2011-05-20 Thread Bill Graham (JIRA)

HBaseStorage fails with multiple STORE statements
-

 Key: PIG-2085
 URL: https://issues.apache.org/jira/browse/PIG-2085
 Project: Pig
  Issue Type: Bug
Reporter: Bill Graham
Assignee: Bill Graham


Scripts with multiple STORE statements using HBaseStorage fail when run against 
a cluster (they succeed in local mode). Below is an example script:

{code}
raw = LOAD 'hbase_split_load_bug.txt' AS
  (f1: chararray, f2:chararray);

SPLIT raw INTO apples IF (f2 == 'apple'), oranges IF (f2 == 'orange');

STORE apples INTO 'hbase://test_table'
   USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:apple');

STORE oranges INTO 'hbase://test_table'
   USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:orange');
{code}

The server throws the following exception after {{apples}} is successfully 
stored:
{code}
Backend error message
-
java.io.IOException: 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@6273305c
 closed
at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:566)
at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1113)
at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatchOfPuts(HConnectionManager.java:1233)
at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:819)
at 
org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.close(TableOutputFormat.java:106)
at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReducePOStoreImpl.tearDown(MapReducePOStoreImpl.java:96)
at 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.tearDown(POStore.java:122)
at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.cleanup(PigMapBase.java:128)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
{code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Pig-trunk-commit #824

2011-05-20 Thread Apache Jenkins Server

See 

Changes:

[rding] PIG-1824: Support import modules in Jython UDF

--
[...truncated 4747 lines...]
-
| buildJar |   57  |   0   |   0   |   8   ||   50  |   0   |
-
[ivy:retrieve] :: retrieving :: org.apache.pig#Pig
[ivy:retrieve]  confs: [buildJar]
[ivy:retrieve]  1 artifacts copied, 49 already retrieved (288kB/12ms)

buildJar:
 [echo] svnString svn: This client is too old to work with working copy 
'  You need
 [echo] to get a newer Subversion client, or to downgrade this working copy.
 [echo] See http://subversion.tigris.org/faq.html#working-copy-format-change
 [echo] for details.
  [jar] Manifest is invalid: Manifest line "to get a newer Subversion 
client, or to downgrade this working cop" is not valid as it does not contain a 
name and a value separated by ': ' 
  [jar] error while reading original manifest in file: 

 Manifest: null
  [jar] Building jar: 

  [jar] Manifest is invalid: Manifest line "to get a newer Subversion 
client, or to downgrade this working cop" is not valid as it does not contain a 
name and a value separated by ': ' 
  [jar] error while reading original manifest in file: 

 Manifest: null
  [jar] Building jar: 

 [copy] Copying 1 file to 


jarWithOutSvn:

findbugs:
[mkdir] Created dir: 

 [findbugs] Executing findbugs from ant task
 [findbugs] Running FindBugs...
 [findbugs] Exception in thread "main" java.io.IOException: invalid header field
 [findbugs] at java.util.jar.Attributes.read(Attributes.java:389)
 [findbugs] at java.util.jar.Manifest.read(Manifest.java:234)
 [findbugs] at java.util.jar.Manifest.(Manifest.java:52)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.scanJarManifestForClassPathEntries(ClassPathBuilder.java:706)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.processWorkList(ClassPathBuilder.java:580)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.build(ClassPathBuilder.java:195)
 [findbugs] at 
edu.umd.cs.findbugs.FindBugs2.buildClassPath(FindBugs2.java:584)
 [findbugs] at edu.umd.cs.findbugs.FindBugs2.execute(FindBugs2.java:181)
 [findbugs] at edu.umd.cs.findbugs.FindBugs.runMain(FindBugs.java:348)
 [findbugs] at edu.umd.cs.findbugs.FindBugs2.main(FindBugs2.java:1057)
 [findbugs] Java Result: 1
 [findbugs] Output saved to 

 [xslt] Processing 

 to 

 [xslt] Loading stylesheet 
/homes/hudson/tools/findbugs/latest/src/xsl/default.xsl
 [xslt] : Error! Premature end of file.
 [xslt] : Error! 
com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Premature end of 
file.
 [xslt] Failed to process 


BUILD FAILED
javax.xml.transform.TransformerException: 
javax.xml.transform.TransformerException: 
com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Premature end of 
file.
at 
com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:719)
at 
com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313)
at 
org.apache.tools.ant.taskdefs.optional.TraXLiaison.transform(TraXLiaison.java:187)
at 
org.apache.tools.ant.taskdefs.XSLTProcess.process(XSLTProcess.java:709)
at 
org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:333)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.apache.too

[jira] [Resolved] (PIG-1824) Support import modules in Jython UDF

2011-05-20 Thread Richard Ding (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Ding resolved PIG-1824.
---

  Resolution: Fixed
Hadoop Flags: [Reviewed]

patch committed to trunk. Thanks Woody!

> Support import modules in Jython UDF
> 
>
> Key: PIG-1824
> URL: https://issues.apache.org/jira/browse/PIG-1824
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Richard Ding
>Assignee: Woody Anderson
> Fix For: 0.10
>
> Attachments: 1824.patch, 1824_final.patch, 1824a.patch, 1824b.patch, 
> 1824c.patch, 1824d.patch, 1824x.patch, 
> TEST-org.apache.pig.test.TestGrunt.txt, 
> TEST-org.apache.pig.test.TestScriptLanguage.txt, 
> TEST-org.apache.pig.test.TestScriptUDF.txt
>
>
> Currently, Jython UDF script doesn't support Jython import statement as in 
> the following example:
> {code}
> #!/usr/bin/python
> import re
> @outputSchema("word:chararray")
> def resplit(content, regex, index):
> return re.compile(regex).split(content)[index]
> {code}
> Can Pig automatically locate the Jython module file and ship it to the 
> backend? Or should we add a ship clause to let user explicitly specify the 
> module to ship? 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Pig-trunk-commit #823

2011-05-20 Thread Apache Jenkins Server

See 

Changes:

[rding] PIG-2081: Dryrun gives wrong line numbers in error message for scripts 
containing macro

--
[...truncated 4747 lines...]
-
| buildJar |   57  |   0   |   0   |   8   ||   50  |   0   |
-
[ivy:retrieve] :: retrieving :: org.apache.pig#Pig
[ivy:retrieve]  confs: [buildJar]
[ivy:retrieve]  1 artifacts copied, 49 already retrieved (288kB/11ms)

buildJar:
 [echo] svnString svn: This client is too old to work with working copy 
'  You need
 [echo] to get a newer Subversion client, or to downgrade this working copy.
 [echo] See http://subversion.tigris.org/faq.html#working-copy-format-change
 [echo] for details.
  [jar] Manifest is invalid: Manifest line "to get a newer Subversion 
client, or to downgrade this working cop" is not valid as it does not contain a 
name and a value separated by ': ' 
  [jar] error while reading original manifest in file: 

 Manifest: null
  [jar] Building jar: 

  [jar] Manifest is invalid: Manifest line "to get a newer Subversion 
client, or to downgrade this working cop" is not valid as it does not contain a 
name and a value separated by ': ' 
  [jar] error while reading original manifest in file: 

 Manifest: null
  [jar] Building jar: 

 [copy] Copying 1 file to 


jarWithOutSvn:

findbugs:
[mkdir] Created dir: 

 [findbugs] Executing findbugs from ant task
 [findbugs] Running FindBugs...
 [findbugs] Exception in thread "main" java.io.IOException: invalid header field
 [findbugs] at java.util.jar.Attributes.read(Attributes.java:389)
 [findbugs] at java.util.jar.Manifest.read(Manifest.java:234)
 [findbugs] at java.util.jar.Manifest.(Manifest.java:52)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.scanJarManifestForClassPathEntries(ClassPathBuilder.java:706)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.processWorkList(ClassPathBuilder.java:580)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.build(ClassPathBuilder.java:195)
 [findbugs] at 
edu.umd.cs.findbugs.FindBugs2.buildClassPath(FindBugs2.java:584)
 [findbugs] at edu.umd.cs.findbugs.FindBugs2.execute(FindBugs2.java:181)
 [findbugs] at edu.umd.cs.findbugs.FindBugs.runMain(FindBugs.java:348)
 [findbugs] at edu.umd.cs.findbugs.FindBugs2.main(FindBugs2.java:1057)
 [findbugs] Java Result: 1
 [findbugs] Output saved to 

 [xslt] Processing 

 to 

 [xslt] Loading stylesheet 
/homes/hudson/tools/findbugs/latest/src/xsl/default.xsl
 [xslt] : Error! Premature end of file.
 [xslt] : Error! 
com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Premature end of 
file.
 [xslt] Failed to process 


BUILD FAILED
javax.xml.transform.TransformerException: 
javax.xml.transform.TransformerException: 
com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Premature end of 
file.
at 
com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:719)
at 
com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313)
at 
org.apache.tools.ant.taskdefs.optional.TraXLiaison.transform(TraXLiaison.java:187)
at 
org.apache.tools.ant.taskdefs.XSLTProcess.process(XSLTProcess.java:709)
at 
org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:333)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(M

[jira] [Commented] (PIG-1824) Support import modules in Jython UDF

2011-05-20 Thread Olga Natkovich (JIRA)


[ 
https://issues.apache.org/jira/browse/PIG-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13037043#comment-13037043
 ] 

Olga Natkovich commented on PIG-1824:
-

Lets get it committed! Thanks, Woody for contributing!

> Support import modules in Jython UDF
> 
>
> Key: PIG-1824
> URL: https://issues.apache.org/jira/browse/PIG-1824
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Richard Ding
>Assignee: Woody Anderson
> Fix For: 0.10
>
> Attachments: 1824.patch, 1824_final.patch, 1824a.patch, 1824b.patch, 
> 1824c.patch, 1824d.patch, 1824x.patch, 
> TEST-org.apache.pig.test.TestGrunt.txt, 
> TEST-org.apache.pig.test.TestScriptLanguage.txt, 
> TEST-org.apache.pig.test.TestScriptUDF.txt
>
>
> Currently, Jython UDF script doesn't support Jython import statement as in 
> the following example:
> {code}
> #!/usr/bin/python
> import re
> @outputSchema("word:chararray")
> def resplit(content, regex, index):
> return re.compile(regex).split(content)[index]
> {code}
> Can Pig automatically locate the Jython module file and ship it to the 
> backend? Or should we add a ship clause to let user explicitly specify the 
> module to ship? 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-1824) Support import modules in Jython UDF

2011-05-20 Thread Richard Ding (JIRA)


[ 
https://issues.apache.org/jira/browse/PIG-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13037039#comment-13037039
 ] 

Richard Ding commented on PIG-1824:
---

Patch passed e2e python tests.

> Support import modules in Jython UDF
> 
>
> Key: PIG-1824
> URL: https://issues.apache.org/jira/browse/PIG-1824
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Richard Ding
>Assignee: Woody Anderson
> Fix For: 0.10
>
> Attachments: 1824.patch, 1824_final.patch, 1824a.patch, 1824b.patch, 
> 1824c.patch, 1824d.patch, 1824x.patch, 
> TEST-org.apache.pig.test.TestGrunt.txt, 
> TEST-org.apache.pig.test.TestScriptLanguage.txt, 
> TEST-org.apache.pig.test.TestScriptUDF.txt
>
>
> Currently, Jython UDF script doesn't support Jython import statement as in 
> the following example:
> {code}
> #!/usr/bin/python
> import re
> @outputSchema("word:chararray")
> def resplit(content, regex, index):
> return re.compile(regex).split(content)[index]
> {code}
> Can Pig automatically locate the Jython module file and ship it to the 
> backend? Or should we add a ship clause to let user explicitly specify the 
> module to ship? 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (PIG-2029) Inconsistency in Pig Stats reports

2011-05-20 Thread Richard Ding (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Ding resolved PIG-2029.
---

  Resolution: Fixed
Hadoop Flags: [Reviewed]

> Inconsistency in Pig Stats reports 
> ---
>
> Key: PIG-2029
> URL: https://issues.apache.org/jira/browse/PIG-2029
> Project: Pig
>  Issue Type: Bug
>  Components: impl
>Affects Versions: 0.8.1, 0.9.0
>Reporter: Viraj Bhat
>Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2029.patch
>
>
> I have a Pig script which reports varying Stats for the same M/R job (same 
> inputs). Sometimes the PigStats reports all the stats (such as 
> Maps,Reduces,MaxMapTime,MinMapTime,AvgMapTime,MaxReduceTime, MinReduceTime 
> and AvgReduceTime) for the M/R job as 0. Sometimes it reports it correctly.
> Enclosed are the stderr logs for 2 runs, you can notice that for Run 1 
> job_201103091134_556600 from Run 1; has 0 against all the columns whereas in 
> Run 2, Hadoop job job_201104272229_75693 has some valid values. 
> The actual Job Tracker link shows that they are non empty. This points to a 
> bug in the interaction of the PigStats module with the Jobtracker.
> Run 1:
> {quote}
> Job Stats (time in seconds):
> JobId MapsReduces MaxMapTime  MinMapTIme  AvgMapTime  
> MaxReduceTime   MinReduceTime   AvgReduceTime   Alias   Feature Outputs
> job_201103091134_556458   160 100 552 191 368 1257
> 371 392 
> IN,SP10P,SP11P,SP12P,SP13P,SP16P,SP17P,SP18P,SP20P,SP21P,SP22P,SP23P,SP24P,SP26P,SP27P,SP28P,SP29P,SP30P,SP31P,SP32P,SP33P,SP34P,SP4P,SP6P,SP7P,SP8P,SP9P
>DISTINCT,MULTI_QUERY
> job_201103091134_556600   0   0   0   0   0   0   
> 0   0   UNION5  MULTI_QUERY,MAP_ONLY/user/viraj/dir,,
> job_201103091134_556601   7   100 17  8   14  200 
> 15  27  CNJOIN25,GNJOIN25,sampleNJOIN25 GROUP_BY,COMBINER   
> job_201103091134_556602   0   0   0   0   0   0   
> 0   0   CNJOIN3,GNJOIN3,sampleNJOIN3GROUP_BY,COMBINER   
> job_201103091134_556603   0   0   0   0   0   0   
> 0   0   CNJOIN15,GNJOIN15,sampleNJOIN15 GROUP_BY,COMBINER   
> job_201103091134_556604   2   100 13  7   10  34  
> 13  31  CNJOIN19,GNJOIN19,sampleNJOIN19 GROUP_BY,COMBINER   
> job_201103091134_556644   0   0   0   0   0   0   
> 0   0   ONJOIN15SAMPLER 
> job_201103091134_556645   0   0   0   0   0   0   
> 0   0   ONJOIN25SAMPLER 
> job_201103091134_556646   0   0   0   0   0   0   
> 0   0   ONJOIN3 SAMPLER 
> job_201103091134_556654   0   0   0   0   0   0   
> 0   0   ONJOIN19SAMPLER 
> job_201103091134_556662   0   0   0   0   0   0   
> 0   0   ONJOIN19ORDER_BY,COMBINER
> ..
> {quote}
> Run 2:
> {quote}
> Job Stats (time in seconds):
> JobId MapsReduces MaxMapTime  MinMapTIme  AvgMapTime  
> MaxReduceTime   MinReduceTime   AvgReduceTime   Alias   Feature Outputs
> job_201104272229_75503159 100 484 192 353 396 
> 308 321 
> IN,SP10P,SP11P,SP12P,SP13P,SP16P,SP17P,SP18P,SP20P,SP21P,SP22P,SP23P,SP24P,SP26P,SP27P,SP28P,SP29P,SP30P,SP31P,SP32P,SP33P,SP34P,SP4P,SP6P,SP7P,SP8P,SP9P
>DISTINCT,MULTI_QUERY
> job_201104272229_7569318  0   31  14  24  0   
> 0   UNION5 MULTI_QUERY,MAP_ONLY /user/viraj/dir,
> job_201104272229_756947   100 34  13  22  46  
> 20  25  CNJOIN25,GNJOIN25,sampleNJOIN25 GROUP_BY,COMBINER   
> job_201104272229_75695125 100 19  11  15  32  
> 18  26  CNJOIN3,GNJOIN3,sampleNJOIN3GROUP_BY,COMBINER   
> job_201104272229_756981   100 12  12  12  13  
> 9   11  CNJOIN15,GNJOIN15,sampleNJOIN15 GROUP_BY,COMBINER   
> job_201104272229_757022   100 21  5   13  35  
> 22  26  CNJOIN19,GNJOIN19,sampleNJOIN19 GROUP_BY,COMBINER   
> job_201104272229_757241   1   4   4   4   11  
> 11  11  ONJOIN15SAMPLER 
> job_201104272229_757250   0   0   0   0   0   
> 0   ONJOIN25SAMPLER 
> job_201104272229_757266   1   8   6   8   24  
> 24  24  ONJOIN3 SAMPLER 
> job_201104272229_757290   0   0   0   0   0   
> 0   ONJOIN

[jira] [Resolved] (PIG-2081) Dryrun gives wrong line numbers in error message for scripts containing macro.

2011-05-20 Thread Richard Ding (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Ding resolved PIG-2081.
---

  Resolution: Fixed
Hadoop Flags: [Reviewed]

patch committed to trunk and 0.9 branch

> Dryrun gives wrong line numbers in error message for scripts containing macro.
> --
>
> Key: PIG-2081
> URL: https://issues.apache.org/jira/browse/PIG-2081
> Project: Pig
>  Issue Type: Bug
>  Components: impl
>Affects Versions: 0.9.0
>Reporter: Richard Ding
>Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2081.patch
>
>
> For following script (test.pig)
> {code}
> 1 DEFINE my_macro (X,key) returns Y
>   2 {
>   3 tmp1 = foreach  $X generate TOKENIZE((chararray)$key) as tokens;
>   4 tmp2 = foreach tmp1 generate flatten(tokens);
>   5 tmp3 = order tmp2 by $0;
>   6 $Y = distinct tmp3;
>   7 }
>   8 
>   9 A = load 'sometext' using TextLoader() as (row) ;
>  10 E = my_macro(A,row);
>  11 
>  12 A1 = load 'sometext2' using TextLoader() as (row1);
>  13 E1 = my_macro(A1,row1);
>  14 
>  15 A3 = load 'sometext3' using TextLoader() as (row3);
>  16 E3 = my_macro(A3,$0);
>  17 
>  18 F = cogroup E by $0, E1 by $0,E3 by $0;
>  19 dump F;
> {code}
> pig test.pig gives correct line number in error message:
> {code}
> ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1200:  column 17>  mismatched input '$0' expecting set null
> {code}
> while pig -r test.pig gives incorrect line number in error message:
> {code}
> ERROR org.apache.pig.Main - ERROR 1200:  column 17>  mismatched input '$0' expecting set null
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-1824) Support import modules in Jython UDF

2011-05-20 Thread Woody Anderson (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Woody Anderson updated PIG-1824:


Release Note: 
module import state is determined before and after user code is executed. The 
resolved modules are inspected and added to the pigContext, then they are added 
to the job jar.

this patch addresses the following import modes:
- import re, which will (if configured) find re on the filesystem in the jython 
install root
- import foo (which can import bar), this works now provided bar is resolvable 
JYTHON_HOME, JYTHONPATH, curdir, etc.
- from pkg import *, which works when the cachedir is writable
- import non.jvm.class, which works when the cachedir is writable
- the directly imported module may use schema decorators, but recursively 
imported modules cannot until PIG-1943 is addressed


  was:
module import state is determined before and after user code is executed. The 
resolved modules are inspected and added to the pigContext, then they are added 
to the job jar.

this patch addresses the following import modes:
- import re, which will (if configured) find re on the filesystem in the jython 
install root
- import foo (which can import bar), this works now provided bar is resolvable 
JYTHON_HOME, JYTHONPATH, curdir, etc.
- from pkg import *, which works when the cachedir is writable
- import non.jvm.class, which works when the cachedir is writable


> Support import modules in Jython UDF
> 
>
> Key: PIG-1824
> URL: https://issues.apache.org/jira/browse/PIG-1824
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Richard Ding
>Assignee: Woody Anderson
> Fix For: 0.10
>
> Attachments: 1824.patch, 1824_final.patch, 1824a.patch, 1824b.patch, 
> 1824c.patch, 1824d.patch, 1824x.patch, 
> TEST-org.apache.pig.test.TestGrunt.txt, 
> TEST-org.apache.pig.test.TestScriptLanguage.txt, 
> TEST-org.apache.pig.test.TestScriptUDF.txt
>
>
> Currently, Jython UDF script doesn't support Jython import statement as in 
> the following example:
> {code}
> #!/usr/bin/python
> import re
> @outputSchema("word:chararray")
> def resplit(content, regex, index):
> return re.compile(regex).split(content)[index]
> {code}
> Can Pig automatically locate the Jython module file and ship it to the 
> backend? Or should we add a ship clause to let user explicitly specify the 
> module to ship? 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2081) Dryrun gives wrong line numbers in error message for scripts containing macro.

2011-05-20 Thread Richard Ding (JIRA)


[ 
https://issues.apache.org/jira/browse/PIG-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13037003#comment-13037003
 ] 

Richard Ding commented on PIG-2081:
---

test-patch and unit tests pass.

> Dryrun gives wrong line numbers in error message for scripts containing macro.
> --
>
> Key: PIG-2081
> URL: https://issues.apache.org/jira/browse/PIG-2081
> Project: Pig
>  Issue Type: Bug
>  Components: impl
>Affects Versions: 0.9.0
>Reporter: Richard Ding
>Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2081.patch
>
>
> For following script (test.pig)
> {code}
> 1 DEFINE my_macro (X,key) returns Y
>   2 {
>   3 tmp1 = foreach  $X generate TOKENIZE((chararray)$key) as tokens;
>   4 tmp2 = foreach tmp1 generate flatten(tokens);
>   5 tmp3 = order tmp2 by $0;
>   6 $Y = distinct tmp3;
>   7 }
>   8 
>   9 A = load 'sometext' using TextLoader() as (row) ;
>  10 E = my_macro(A,row);
>  11 
>  12 A1 = load 'sometext2' using TextLoader() as (row1);
>  13 E1 = my_macro(A1,row1);
>  14 
>  15 A3 = load 'sometext3' using TextLoader() as (row3);
>  16 E3 = my_macro(A3,$0);
>  17 
>  18 F = cogroup E by $0, E1 by $0,E3 by $0;
>  19 dump F;
> {code}
> pig test.pig gives correct line number in error message:
> {code}
> ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1200:  column 17>  mismatched input '$0' expecting set null
> {code}
> while pig -r test.pig gives incorrect line number in error message:
> {code}
> ERROR org.apache.pig.Main - ERROR 1200:  column 17>  mismatched input '$0' expecting set null
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2081) Dryrun gives wrong line numbers in error message for scripts containing macro.

2011-05-20 Thread Thejas M Nair (JIRA)


[ 
https://issues.apache.org/jira/browse/PIG-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036960#comment-13036960
 ] 

Thejas M Nair commented on PIG-2081:


+1

> Dryrun gives wrong line numbers in error message for scripts containing macro.
> --
>
> Key: PIG-2081
> URL: https://issues.apache.org/jira/browse/PIG-2081
> Project: Pig
>  Issue Type: Bug
>  Components: impl
>Affects Versions: 0.9.0
>Reporter: Richard Ding
>Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2081.patch
>
>
> For following script (test.pig)
> {code}
> 1 DEFINE my_macro (X,key) returns Y
>   2 {
>   3 tmp1 = foreach  $X generate TOKENIZE((chararray)$key) as tokens;
>   4 tmp2 = foreach tmp1 generate flatten(tokens);
>   5 tmp3 = order tmp2 by $0;
>   6 $Y = distinct tmp3;
>   7 }
>   8 
>   9 A = load 'sometext' using TextLoader() as (row) ;
>  10 E = my_macro(A,row);
>  11 
>  12 A1 = load 'sometext2' using TextLoader() as (row1);
>  13 E1 = my_macro(A1,row1);
>  14 
>  15 A3 = load 'sometext3' using TextLoader() as (row3);
>  16 E3 = my_macro(A3,$0);
>  17 
>  18 F = cogroup E by $0, E1 by $0,E3 by $0;
>  19 dump F;
> {code}
> pig test.pig gives correct line number in error message:
> {code}
> ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1200:  column 17>  mismatched input '$0' expecting set null
> {code}
> while pig -r test.pig gives incorrect line number in error message:
> {code}
> ERROR org.apache.pig.Main - ERROR 1200:  column 17>  mismatched input '$0' expecting set null
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (PIG-2084) pig is running validation for a statement at a time batch mode, instead of running it for whole script

2011-05-20 Thread Thejas M Nair (JIRA)

pig is running validation for a statement at a time batch mode, instead of 
running it for whole script
--

 Key: PIG-2084
 URL: https://issues.apache.org/jira/browse/PIG-2084
 Project: Pig
  Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Thejas M Nair
Assignee: Thejas M Nair
 Fix For: 0.9.0


In PIG-2059, a change was made to run validation for each statement instead of 
running it once for the whole script.
This slows down the validation phase, and it ends up taking tens of seconds.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (PIG-2082) bincond ERROR 1050: Unsupported typ for BindCond: left hand side: tuple

2011-05-20 Thread Olga Natkovich (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Olga Natkovich reassigned PIG-2082:
---

Assignee: Thejas M Nair

> bincond ERROR 1050: Unsupported typ for BindCond: left hand side: tuple 
> 
>
> Key: PIG-2082
> URL: https://issues.apache.org/jira/browse/PIG-2082
> Project: Pig
>  Issue Type: Bug
>  Components: build
>Affects Versions: 0.9.0
> Environment: Linux 2.6.18-53.1.13.el5 #1 SMP Mon Feb 11 13:27:27 EST 
> 2008 x86_64 x86_64 x86_64 GNU/Linux
> Hadoop 0.20.203.3.1104011556 Compiled on Fri Apr  1 16:29:09 PDT 2011
>Reporter: Araceli Henley
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
>
> Regression for 9, this passes on 8
> 2011-05-19 00:28:31,619 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
> 1050 Unsupported
> input type for BinCond: left hand side: tuple; right hand side: double
> a = load '1.txt' as (a0, a1);
> b = foreach a generate (a0==0?(1):{a1/5));
> explain b;

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2084) pig is running validation for a statement at a time batch mode, instead of running it for whole script

2011-05-20 Thread Thejas M Nair (JIRA)


[ 
https://issues.apache.org/jira/browse/PIG-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036952#comment-13036952
 ] 

Thejas M Nair commented on PIG-2084:


To fix this, the per-statement validation should be enabled only for 
interactive mode and if the -c option (check) is used.


> pig is running validation for a statement at a time batch mode, instead of 
> running it for whole script
> --
>
> Key: PIG-2084
> URL: https://issues.apache.org/jira/browse/PIG-2084
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
>
> In PIG-2059, a change was made to run validation for each statement instead 
> of running it once for the whole script.
> This slows down the validation phase, and it ends up taking tens of seconds.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (PIG-2083) bincond ERROR 1025: Invalid field projection when null is used

2011-05-20 Thread Olga Natkovich (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Olga Natkovich reassigned PIG-2083:
---

Assignee: Thejas M Nair

> bincond ERROR 1025: Invalid field projection when null is used
> --
>
> Key: PIG-2083
> URL: https://issues.apache.org/jira/browse/PIG-2083
> Project: Pig
>  Issue Type: Bug
>  Components: build
>Affects Versions: 0.9.0
> Environment: Linux 2.6.18-53.1.13.el5 #1 SMP Mon Feb 11 13:27:27 EST 
> 2008 x86_64 x86_64 x86_64 GNU/Linux
> Hadoop 0.20.203.3.1104011556 -r 96519d04f65e22ffadf89b225d0d44ef1741d126
> Compiled on Fri Apr  1 16:29:09 PDT 2011
>Reporter: Araceli Henley
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
>
> This is a regression for 9.
> a = load '1.txt' as (a0, a1);
> b = foreach a generate (a0==0?null:2);
> explain b;
> ERROR 1025:
> Invalid field projection. Projected field [null] does not exist in schema

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (PIG-2083) bincond ERROR 1025: Invalid field projection when null is used

2011-05-20 Thread Araceli Henley (JIRA)

bincond ERROR 1025: Invalid field projection when null is used
--

 Key: PIG-2083
 URL: https://issues.apache.org/jira/browse/PIG-2083
 Project: Pig
  Issue Type: Bug
  Components: build
Affects Versions: 0.9.0
 Environment: 
Linux 2.6.18-53.1.13.el5 #1 SMP Mon Feb 11 13:27:27 EST 2008 x86_64 x86_64 
x86_64 GNU/Linux

Hadoop 0.20.203.3.1104011556 -r 96519d04f65e22ffadf89b225d0d44ef1741d126
Compiled on Fri Apr  1 16:29:09 PDT 2011


Reporter: Araceli Henley
 Fix For: 0.9.0


This is a regression for 9.

a = load '1.txt' as (a0, a1);
b = foreach a generate (a0==0?null:2);
explain b;

ERROR 1025:
Invalid field projection. Projected field [null] does not exist in schema



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (PIG-2082) bincond ERROR 1050: Unsupported typ for BindCond: left hand side: tuple

2011-05-20 Thread Araceli Henley (JIRA)

bincond ERROR 1050: Unsupported typ for BindCond: left hand side: tuple 


 Key: PIG-2082
 URL: https://issues.apache.org/jira/browse/PIG-2082
 Project: Pig
  Issue Type: Bug
  Components: build
Affects Versions: 0.9.0
 Environment: Linux 2.6.18-53.1.13.el5 #1 SMP Mon Feb 11 13:27:27 EST 
2008 x86_64 x86_64 x86_64 GNU/Linux

Hadoop 0.20.203.3.1104011556 Compiled on Fri Apr  1 16:29:09 PDT 2011

Reporter: Araceli Henley
 Fix For: 0.9.0


Regression for 9, this passes on 8


2011-05-19 00:28:31,619 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
1050 Unsupported
input type for BinCond: left hand side: tuple; right hand side: double

a = load '1.txt' as (a0, a1);
b = foreach a generate (a0==0?(1):{a1/5));
explain b;


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Pig-trunk #1019

2011-05-20 Thread Apache Jenkins Server

See 

Changes:

[tomwhite] Include 32-bit and 64-bit native libraries in Jenkins tarball builds

[rding] Replace RuntimeException with ParserException

--
[...truncated 4249 lines...]
-
| buildJar |   57  |   0   |   0   |   8   ||   50  |   0   |
-
[ivy:retrieve] :: retrieving :: org.apache.pig#Pig
[ivy:retrieve]  confs: [buildJar]
[ivy:retrieve]  1 artifacts copied, 49 already retrieved (288kB/9ms)

buildJar:
 [echo] svnString svn: This client is too old to work with working copy 
'  You need
 [echo] to get a newer Subversion client, or to downgrade this working copy.
 [echo] See http://subversion.tigris.org/faq.html#working-copy-format-change
 [echo] for details.
  [jar] Manifest is invalid: Manifest line "to g" is not valid as it does 
not contain a name and a value separated by ': ' 
  [jar] error while reading original manifest in file: 

 Manifest: null
  [jar] Building jar: 

  [jar] Manifest is invalid: Manifest line "to g" is not valid as it does 
not contain a name and a value separated by ': ' 
  [jar] error while reading original manifest in file: 

 Manifest: null
  [jar] Building jar: 

 [copy] Copying 1 file to 


jarWithOutSvn:

findbugs:
[mkdir] Created dir: 

 [findbugs] Executing findbugs from ant task
 [findbugs] Running FindBugs...
 [findbugs] Exception in thread "main" java.io.IOException: invalid header field
 [findbugs] at java.util.jar.Attributes.read(Attributes.java:389)
 [findbugs] at java.util.jar.Manifest.read(Manifest.java:234)
 [findbugs] at java.util.jar.Manifest.(Manifest.java:52)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.scanJarManifestForClassPathEntries(ClassPathBuilder.java:706)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.processWorkList(ClassPathBuilder.java:580)
 [findbugs] at 
edu.umd.cs.findbugs.classfile.impl.ClassPathBuilder.build(ClassPathBuilder.java:195)
 [findbugs] at 
edu.umd.cs.findbugs.FindBugs2.buildClassPath(FindBugs2.java:584)
 [findbugs] at edu.umd.cs.findbugs.FindBugs2.execute(FindBugs2.java:181)
 [findbugs] at edu.umd.cs.findbugs.FindBugs.runMain(FindBugs.java:348)
 [findbugs] at edu.umd.cs.findbugs.FindBugs2.main(FindBugs2.java:1057)
 [findbugs] Java Result: 1
 [findbugs] Output saved to 

 [xslt] Processing 

 to 

 [xslt] Loading stylesheet 
/homes/hudson/tools/findbugs/latest/src/xsl/default.xsl
 [xslt] : Error! Premature end of file.
 [xslt] : Error! 
com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Premature end of 
file.
 [xslt] Failed to process 


BUILD FAILED
javax.xml.transform.TransformerException: 
javax.xml.transform.TransformerException: 
com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Premature end of 
file.
at 
com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:719)
at 
com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313)
at 
org.apache.tools.ant.taskdefs.optional.TraXLiaison.transform(TraXLiaison.java:187)
at 
org.apache.tools.ant.taskdefs.XSLTProcess.process(XSLTProcess.java:709)
at 
org.apache.tools.ant.taskdefs.XSLTProcess.execute(XSLTProcess.java:333)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
at org.apache.tools.ant.Task.perform(Task.ja

[jira] [Created] (PIG-2086) grunt parser fails for: load .. as \n (b:bag{});

[jira] [Updated] (PIG-1772) Pig 090 Documentation

[jira] [Updated] (PIG-1772) Pig 090 Documentation

Build failed in Jenkins: Pig-trunk #1020

[jira] [Updated] (PIG-2085) HBaseStorage fails with multiple STORE statements

[jira] [Created] (PIG-2085) HBaseStorage fails with multiple STORE statements

Build failed in Jenkins: Pig-trunk-commit #824

[jira] [Resolved] (PIG-1824) Support import modules in Jython UDF

Build failed in Jenkins: Pig-trunk-commit #823

[jira] [Commented] (PIG-1824) Support import modules in Jython UDF

[jira] [Commented] (PIG-1824) Support import modules in Jython UDF

[jira] [Resolved] (PIG-2029) Inconsistency in Pig Stats reports

[jira] [Resolved] (PIG-2081) Dryrun gives wrong line numbers in error message for scripts containing macro.

[jira] [Updated] (PIG-1824) Support import modules in Jython UDF

[jira] [Commented] (PIG-2081) Dryrun gives wrong line numbers in error message for scripts containing macro.

[jira] [Commented] (PIG-2081) Dryrun gives wrong line numbers in error message for scripts containing macro.

[jira] [Created] (PIG-2084) pig is running validation for a statement at a time batch mode, instead of running it for whole script

[jira] [Assigned] (PIG-2082) bincond ERROR 1050: Unsupported typ for BindCond: left hand side: tuple

[jira] [Commented] (PIG-2084) pig is running validation for a statement at a time batch mode, instead of running it for whole script

[jira] [Assigned] (PIG-2083) bincond ERROR 1025: Invalid field projection when null is used

[jira] [Created] (PIG-2083) bincond ERROR 1025: Invalid field projection when null is used

[jira] [Created] (PIG-2082) bincond ERROR 1050: Unsupported typ for BindCond: left hand side: tuple

Build failed in Jenkins: Pig-trunk #1019

23 matches

Site Navigation

Mail list logo

Footer information