date:20110516

[jira] [Updated] (PIG-2029) Inconsistency in Pig Stats reports

2011-05-16 Thread Olga Natkovich (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Olga Natkovich updated PIG-2029:


Fix Version/s: (was: 0.9.0)
   0.10

> Inconsistency in Pig Stats reports 
> ---
>
> Key: PIG-2029
> URL: https://issues.apache.org/jira/browse/PIG-2029
> Project: Pig
>  Issue Type: Bug
>  Components: impl
>Affects Versions: 0.8.1, 0.9.0
>Reporter: Viraj Bhat
>Assignee: Richard Ding
> Fix For: 0.10
>
>
> I have a Pig script which reports varying Stats for the same M/R job (same 
> inputs). Sometimes the PigStats reports all the stats (such as 
> Maps,Reduces,MaxMapTime,MinMapTime,AvgMapTime,MaxReduceTime, MinReduceTime 
> and AvgReduceTime) for the M/R job as 0. Sometimes it reports it correctly.
> Enclosed are the stderr logs for 2 runs, you can notice that for Run 1 
> job_201103091134_556600 from Run 1; has 0 against all the columns whereas in 
> Run 2, Hadoop job job_201104272229_75693 has some valid values. 
> The actual Job Tracker link shows that they are non empty. This points to a 
> bug in the interaction of the PigStats module with the Jobtracker.
> Run 1:
> {quote}
> Job Stats (time in seconds):
> JobId MapsReduces MaxMapTime  MinMapTIme  AvgMapTime  
> MaxReduceTime   MinReduceTime   AvgReduceTime   Alias   Feature Outputs
> job_201103091134_556458   160 100 552 191 368 1257
> 371 392 
> IN,SP10P,SP11P,SP12P,SP13P,SP16P,SP17P,SP18P,SP20P,SP21P,SP22P,SP23P,SP24P,SP26P,SP27P,SP28P,SP29P,SP30P,SP31P,SP32P,SP33P,SP34P,SP4P,SP6P,SP7P,SP8P,SP9P
>DISTINCT,MULTI_QUERY
> job_201103091134_556600   0   0   0   0   0   0   
> 0   0   UNION5  MULTI_QUERY,MAP_ONLY/user/viraj/dir,,
> job_201103091134_556601   7   100 17  8   14  200 
> 15  27  CNJOIN25,GNJOIN25,sampleNJOIN25 GROUP_BY,COMBINER   
> job_201103091134_556602   0   0   0   0   0   0   
> 0   0   CNJOIN3,GNJOIN3,sampleNJOIN3GROUP_BY,COMBINER   
> job_201103091134_556603   0   0   0   0   0   0   
> 0   0   CNJOIN15,GNJOIN15,sampleNJOIN15 GROUP_BY,COMBINER   
> job_201103091134_556604   2   100 13  7   10  34  
> 13  31  CNJOIN19,GNJOIN19,sampleNJOIN19 GROUP_BY,COMBINER   
> job_201103091134_556644   0   0   0   0   0   0   
> 0   0   ONJOIN15SAMPLER 
> job_201103091134_556645   0   0   0   0   0   0   
> 0   0   ONJOIN25SAMPLER 
> job_201103091134_556646   0   0   0   0   0   0   
> 0   0   ONJOIN3 SAMPLER 
> job_201103091134_556654   0   0   0   0   0   0   
> 0   0   ONJOIN19SAMPLER 
> job_201103091134_556662   0   0   0   0   0   0   
> 0   0   ONJOIN19ORDER_BY,COMBINER
> ..
> {quote}
> Run 2:
> {quote}
> Job Stats (time in seconds):
> JobId MapsReduces MaxMapTime  MinMapTIme  AvgMapTime  
> MaxReduceTime   MinReduceTime   AvgReduceTime   Alias   Feature Outputs
> job_201104272229_75503159 100 484 192 353 396 
> 308 321 
> IN,SP10P,SP11P,SP12P,SP13P,SP16P,SP17P,SP18P,SP20P,SP21P,SP22P,SP23P,SP24P,SP26P,SP27P,SP28P,SP29P,SP30P,SP31P,SP32P,SP33P,SP34P,SP4P,SP6P,SP7P,SP8P,SP9P
>DISTINCT,MULTI_QUERY
> job_201104272229_7569318  0   31  14  24  0   
> 0   UNION5 MULTI_QUERY,MAP_ONLY /user/viraj/dir,
> job_201104272229_756947   100 34  13  22  46  
> 20  25  CNJOIN25,GNJOIN25,sampleNJOIN25 GROUP_BY,COMBINER   
> job_201104272229_75695125 100 19  11  15  32  
> 18  26  CNJOIN3,GNJOIN3,sampleNJOIN3GROUP_BY,COMBINER   
> job_201104272229_756981   100 12  12  12  13  
> 9   11  CNJOIN15,GNJOIN15,sampleNJOIN15 GROUP_BY,COMBINER   
> job_201104272229_757022   100 21  5   13  35  
> 22  26  CNJOIN19,GNJOIN19,sampleNJOIN19 GROUP_BY,COMBINER   
> job_201104272229_757241   1   4   4   4   11  
> 11  11  ONJOIN15SAMPLER 
> job_201104272229_757250   0   0   0   0   0   
> 0   ONJOIN25SAMPLER 
> job_201104272229_757266   1   8   6   8   24  
> 24  24  ONJOIN3 SAMPLER 
> job_201104272229_757290   0   0   0   0   0   
> 0   ONJOIN19SAMPLER 
> job_20110427222

[jira] [Updated] (PIG-1824) Support import modules in Jython UDF

2011-05-16 Thread Woody Anderson (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Woody Anderson updated PIG-1824:


Attachment: 1824x.patch

patch for trunk

> Support import modules in Jython UDF
> 
>
> Key: PIG-1824
> URL: https://issues.apache.org/jira/browse/PIG-1824
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Richard Ding
>Assignee: Woody Anderson
> Fix For: 0.10
>
> Attachments: 1824.patch, 1824a.patch, 1824b.patch, 1824c.patch, 
> 1824d.patch, 1824x.patch
>
>
> Currently, Jython UDF script doesn't support Jython import statement as in 
> the following example:
> {code}
> #!/usr/bin/python
> import re
> @outputSchema("word:chararray")
> def resplit(content, regex, index):
> return re.compile(regex).split(content)[index]
> {code}
> Can Pig automatically locate the Jython module file and ship it to the 
> backend? Or should we add a ship clause to let user explicitly specify the 
> module to ship? 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: New DOAP file for Pig Project

2011-05-16 Thread sebb

Added:

URL: http://svn.apache.org/viewvc?rev=1103829&view=rev
Log:
+= pig.doap

Modified:
   infrastructure/site-tools/trunk/projects/files.xml

Please note that Trademarks (such as Pig) should be used as
adjectives, not nouns, so please change the Doap accordingly [1]

[1] http://www.apache.org/foundation/marks/pmcs#adjective

On 16 May 2011 19:07, Alan Gates  wrote:
> I have a DOAP file for the Pig project that I would like to have listed on
> http://projects.apache.org/  The file is available at
>  http://svn.apache.org/repos/asf/pig/trunk/doap_Pig.rdf
>
> Thanks.
>
> Alan.
>

Build failed in Jenkins: Pig-trunk-commit #818

2011-05-16 Thread Apache Jenkins Server

See 

Changes:

[thejas] PIG-2071: casting numeric type to chararray during schema merge for 
union
 is inconsistent with other schema merge cases

[thejas] PIG-2070: "Unknown" appears in error message for an error case

--
[...truncated 5554 lines...]
  [javadoc] Loading source files for package 
org.apache.pig.backend.datastorage...
  [javadoc] Loading source files for package 
org.apache.pig.backend.executionengine...
  [javadoc] Loading source files for package org.apache.pig.backend.hadoop...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.datastorage...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.regex...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.util...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.util...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.hbase...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.streaming...
  [javadoc] Loading source files for package org.apache.pig.builtin...
  [javadoc] Loading source files for package org.apache.pig.classification...
  [javadoc] Loading source files for package org.apache.pig.data...
  [javadoc] Loading source files for package org.apache.pig.impl...
  [javadoc] Loading source files for package org.apache.pig.impl.builtin...
  [javadoc] Loading source files for package org.apache.pig.impl.io...
  [javadoc] Loading source files for package org.apache.pig.impl.logicalLayer...
  [javadoc] Loading source files for package 
org.apache.pig.impl.logicalLayer.schema...
  [javadoc] Loading source files for package 
org.apache.pig.impl.logicalLayer.validators...
  [javadoc] Loading source files for package org.apache.pig.impl.plan...
  [javadoc] Loading source files for package 
org.apache.pig.impl.plan.optimizer...
  [javadoc] Loading source files for package org.apache.pig.impl.streaming...
  [javadoc] Loading source files for package org.apache.pig.impl.util...
  [javadoc] Loading source files for package org.apache.pig.newplan...
  [javadoc] Loading source files for package org.apache.pig.newplan.logical...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.expression...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.optimizer...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.relational...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.rules...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.visitor...
  [javadoc] Loading source files for package org.apache.pig.newplan.optimizer...
  [javadoc] Loading source files for package org.apache.pig.parser...
  [javadoc] Loading source files for package org.apache.pig.pen...
  [javadoc] Loading source files for package org.apache.pig.pen.util...
  [javadoc] Loading source files for package org.apache.pig.scripting...
  [javadoc] Loading source files for package org.apache.pig.scripting.js...
  [javadoc] Loading source files for package org.apache.pig.scripting.jython...
  [javadoc] Loading source files for package org.apache.pig.tools...
  [javadoc] Loading source files for package org.apache.pig.tools.cmdline...
  [javadoc] Loading source files for package org.apache.pig.tools.grunt...
  [javadoc] Loading source files for package org.apache.pig.tools.parameters...
  [javadoc] Loading source files for package org.apache.pig.tools.pigstats...
  [javadoc] Loading source files for package org.apache.pig.tools.streams...
  [javadoc] Loading source files for package org.apache.pig.tools.timer...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.6.0_23
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packag

[jira] [Resolved] (PIG-2070) "Unknown" appears in error message for an error case

2011-05-16 Thread Thejas M Nair (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair resolved PIG-2070.


Resolution: Fixed

Patch committed to trunk and 0.9 branch.


> "Unknown" appears in error message for an error case
> 
>
> Key: PIG-2070
> URL: https://issues.apache.org/jira/browse/PIG-2070
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Xuefu Zhang
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
> Attachments: PIG-2070.1.patch
>
>
> For the following query:
> a = load '1.txt' as (a0:int, a1:int);
> b = load '2.txt' as (a0:int, a1:chararray);
> c = cogroup a by (a0,a1), b by (a0,a1);
> Pig gives the following message, which includes "unknown" word. 
> 2011-05-13 11:01:18,682 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
> 1051:
>  Cannot cast to Unknown
> The error message should be more meaningful.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (PIG-2071) casting numeric type to chararray during schema merge for union is inconsistent with other schema merge cases

2011-05-16 Thread Thejas M Nair (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair resolved PIG-2071.


Resolution: Fixed

Patch committed to trunk and 0.9 branch.


> casting numeric type to chararray during schema merge for union is 
> inconsistent with other schema merge cases
> -
>
> Key: PIG-2071
> URL: https://issues.apache.org/jira/browse/PIG-2071
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
> Attachments: PIG-2071.1.patch
>
>
> In PIG-1536, if a column in output of union has a source column one input of 
> type charraray and in other it is of a numeric type, the column of numeric 
> type will be cast to chararray. But in all other cases, chararray and numeric 
> types are considered incompatible, and as a result such implicit casting is 
> not done.
> To be consistent with other cases, union also should consider chararray and 
> numeric types to be incompatible.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

New DOAP file for Pig Project

2011-05-16 Thread Alan Gates

I have a DOAP file for the Pig project that I would like to have  
listed on http://projects.apache.org/  The file is available at  http://svn.apache.org/repos/asf/pig/trunk/doap_Pig.rdf


Thanks.

Alan.

Build failed in Jenkins: Pig-trunk-commit #817

2011-05-16 Thread Apache Jenkins Server

See 

Changes:

[gates] Added doap file.  This will be used in listing Pig on Apache's index of 
sites: http://projects.apache.org/index.html

[rding] PIG-2069: LoadFunc jar does not ship to backend in MultiQuery case

--
[...truncated 5562 lines...]
  [javadoc] Loading source files for package 
org.apache.pig.backend.datastorage...
  [javadoc] Loading source files for package 
org.apache.pig.backend.executionengine...
  [javadoc] Loading source files for package org.apache.pig.backend.hadoop...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.datastorage...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.regex...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.util...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.util...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.hbase...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.streaming...
  [javadoc] Loading source files for package org.apache.pig.builtin...
  [javadoc] Loading source files for package org.apache.pig.classification...
  [javadoc] Loading source files for package org.apache.pig.data...
  [javadoc] Loading source files for package org.apache.pig.impl...
  [javadoc] Loading source files for package org.apache.pig.impl.builtin...
  [javadoc] Loading source files for package org.apache.pig.impl.io...
  [javadoc] Loading source files for package org.apache.pig.impl.logicalLayer...
  [javadoc] Loading source files for package 
org.apache.pig.impl.logicalLayer.schema...
  [javadoc] Loading source files for package 
org.apache.pig.impl.logicalLayer.validators...
  [javadoc] Loading source files for package org.apache.pig.impl.plan...
  [javadoc] Loading source files for package 
org.apache.pig.impl.plan.optimizer...
  [javadoc] Loading source files for package org.apache.pig.impl.streaming...
  [javadoc] Loading source files for package org.apache.pig.impl.util...
  [javadoc] Loading source files for package org.apache.pig.newplan...
  [javadoc] Loading source files for package org.apache.pig.newplan.logical...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.expression...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.optimizer...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.relational...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.rules...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.visitor...
  [javadoc] Loading source files for package org.apache.pig.newplan.optimizer...
  [javadoc] Loading source files for package org.apache.pig.parser...
  [javadoc] Loading source files for package org.apache.pig.pen...
  [javadoc] Loading source files for package org.apache.pig.pen.util...
  [javadoc] Loading source files for package org.apache.pig.scripting...
  [javadoc] Loading source files for package org.apache.pig.scripting.js...
  [javadoc] Loading source files for package org.apache.pig.scripting.jython...
  [javadoc] Loading source files for package org.apache.pig.tools...
  [javadoc] Loading source files for package org.apache.pig.tools.cmdline...
  [javadoc] Loading source files for package org.apache.pig.tools.grunt...
  [javadoc] Loading source files for package org.apache.pig.tools.parameters...
  [javadoc] Loading source files for package org.apache.pig.tools.pigstats...
  [javadoc] Loading source files for package org.apache.pig.tools.streams...
  [javadoc] Loading source files for package org.apache.pig.tools.timer...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.6.0_23
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages

[jira] [Commented] (PIG-2070) "Unknown" appears in error message for an error case

2011-05-16 Thread Richard Ding (JIRA)


[ 
https://issues.apache.org/jira/browse/PIG-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034135#comment-13034135
 ] 

Richard Ding commented on PIG-2070:
---

+1

> "Unknown" appears in error message for an error case
> 
>
> Key: PIG-2070
> URL: https://issues.apache.org/jira/browse/PIG-2070
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Xuefu Zhang
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
> Attachments: PIG-2070.1.patch
>
>
> For the following query:
> a = load '1.txt' as (a0:int, a1:int);
> b = load '2.txt' as (a0:int, a1:chararray);
> c = cogroup a by (a0,a1), b by (a0,a1);
> Pig gives the following message, which includes "unknown" word. 
> 2011-05-13 11:01:18,682 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
> 1051:
>  Cannot cast to Unknown
> The error message should be more meaningful.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2071) casting numeric type to chararray during schema merge for union is inconsistent with other schema merge cases

2011-05-16 Thread Daniel Dai (JIRA)


[ 
https://issues.apache.org/jira/browse/PIG-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034115#comment-13034115
 ] 

Daniel Dai commented on PIG-2071:
-

+1

> casting numeric type to chararray during schema merge for union is 
> inconsistent with other schema merge cases
> -
>
> Key: PIG-2071
> URL: https://issues.apache.org/jira/browse/PIG-2071
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
> Attachments: PIG-2071.1.patch
>
>
> In PIG-1536, if a column in output of union has a source column one input of 
> type charraray and in other it is of a numeric type, the column of numeric 
> type will be cast to chararray. But in all other cases, chararray and numeric 
> types are considered incompatible, and as a result such implicit casting is 
> not done.
> To be consistent with other cases, union also should consider chararray and 
> numeric types to be incompatible.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (PIG-2069) LoadFunc jar does not ship to backend in MultiQuery case

2011-05-16 Thread Richard Ding (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Ding resolved PIG-2069.
---

  Resolution: Fixed
Hadoop Flags: [Reviewed]

Unit tests pass. Patch committed to trunk and 0.9 branch.

> LoadFunc jar does not ship to backend in MultiQuery case
> 
>
> Key: PIG-2069
> URL: https://issues.apache.org/jira/browse/PIG-2069
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.8.1, 0.9.0
>Reporter: Daniel Dai
>Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-2069.patch
>
>
> Pig is able to automatically figure out the jar containing the LoadFunc and 
> ship them to backend. However, the following script didn't:
> {code}
> A = load '1.txt' using SomeLoadFunc();
> B = filter A by $0==0;
> C = filter A by $1==1;
> D = join B by $0, C by $0;
> dump D;
> {code}
> The reason is this query is a multiquery (A is reused and thus create an 
> implicit split). When we merge multiquery into one job, we didn't merge udfs 
> list properly.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Pig-trunk-commit #816

2011-05-16 Thread Apache Jenkins Server

See 

Changes:

[thejas] PIG-2076: update documentation, help command with correct default 
value of pig.cachedbag.memusage

--
[...truncated 5561 lines...]
  [javadoc] Loading source files for package 
org.apache.pig.backend.datastorage...
  [javadoc] Loading source files for package 
org.apache.pig.backend.executionengine...
  [javadoc] Loading source files for package org.apache.pig.backend.hadoop...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.datastorage...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.regex...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.util...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.util...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.hbase...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.streaming...
  [javadoc] Loading source files for package org.apache.pig.builtin...
  [javadoc] Loading source files for package org.apache.pig.classification...
  [javadoc] Loading source files for package org.apache.pig.data...
  [javadoc] Loading source files for package org.apache.pig.impl...
  [javadoc] Loading source files for package org.apache.pig.impl.builtin...
  [javadoc] Loading source files for package org.apache.pig.impl.io...
  [javadoc] Loading source files for package org.apache.pig.impl.logicalLayer...
  [javadoc] Loading source files for package 
org.apache.pig.impl.logicalLayer.schema...
  [javadoc] Loading source files for package 
org.apache.pig.impl.logicalLayer.validators...
  [javadoc] Loading source files for package org.apache.pig.impl.plan...
  [javadoc] Loading source files for package 
org.apache.pig.impl.plan.optimizer...
  [javadoc] Loading source files for package org.apache.pig.impl.streaming...
  [javadoc] Loading source files for package org.apache.pig.impl.util...
  [javadoc] Loading source files for package org.apache.pig.newplan...
  [javadoc] Loading source files for package org.apache.pig.newplan.logical...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.expression...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.optimizer...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.relational...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.rules...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.visitor...
  [javadoc] Loading source files for package org.apache.pig.newplan.optimizer...
  [javadoc] Loading source files for package org.apache.pig.parser...
  [javadoc] Loading source files for package org.apache.pig.pen...
  [javadoc] Loading source files for package org.apache.pig.pen.util...
  [javadoc] Loading source files for package org.apache.pig.scripting...
  [javadoc] Loading source files for package org.apache.pig.scripting.js...
  [javadoc] Loading source files for package org.apache.pig.scripting.jython...
  [javadoc] Loading source files for package org.apache.pig.tools...
  [javadoc] Loading source files for package org.apache.pig.tools.cmdline...
  [javadoc] Loading source files for package org.apache.pig.tools.grunt...
  [javadoc] Loading source files for package org.apache.pig.tools.parameters...
  [javadoc] Loading source files for package org.apache.pig.tools.pigstats...
  [javadoc] Loading source files for package org.apache.pig.tools.streams...
  [javadoc] Loading source files for package org.apache.pig.tools.timer...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.6.0_23
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...

javadoc-jar:
  [jar] Buildi

[jira] [Updated] (PIG-2071) casting numeric type to chararray during schema merge for union is inconsistent with other schema merge cases

2011-05-16 Thread Thejas M Nair (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair updated PIG-2071:
---

Attachment: PIG-2071.1.patch

PIG-2071.1.patch - test-patch and unit tests succeeded with this patch.  
(except for one test that is currently failing in trunk as well).

> casting numeric type to chararray during schema merge for union is 
> inconsistent with other schema merge cases
> -
>
> Key: PIG-2071
> URL: https://issues.apache.org/jira/browse/PIG-2071
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
> Attachments: PIG-2071.1.patch
>
>
> In PIG-1536, if a column in output of union has a source column one input of 
> type charraray and in other it is of a numeric type, the column of numeric 
> type will be cast to chararray. But in all other cases, chararray and numeric 
> types are considered incompatible, and as a result such implicit casting is 
> not done.
> To be consistent with other cases, union also should consider chararray and 
> numeric types to be incompatible.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2070) "Unknown" appears in error message for an error case

2011-05-16 Thread Thejas M Nair (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair updated PIG-2070:
---

Attachment: PIG-2070.1.patch

PIG-2070.1.patch - test-patch and unit tests have passed with this patch. 
(except for one test that is currently failing in trunk as well).

> "Unknown" appears in error message for an error case
> 
>
> Key: PIG-2070
> URL: https://issues.apache.org/jira/browse/PIG-2070
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Xuefu Zhang
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
> Attachments: PIG-2070.1.patch
>
>
> For the following query:
> a = load '1.txt' as (a0:int, a1:int);
> b = load '2.txt' as (a0:int, a1:chararray);
> c = cogroup a by (a0,a1), b by (a0,a1);
> Pig gives the following message, which includes "unknown" word. 
> 2011-05-13 11:01:18,682 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
> 1051:
>  Cannot cast to Unknown
> The error message should be more meaningful.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (PIG-2076) update documentation, help command with correct default value of pig.cachedbag.memusage

2011-05-16 Thread Thejas M Nair (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair resolved PIG-2076.


Resolution: Fixed

Test-patch succeeded, ran test-commit as the change is a minor change to 
documentation and a message string - that succeeded as well.
Patch committed to trunk and 0.9 branch.


> update documentation, help command with correct default value of 
> pig.cachedbag.memusage
> ---
>
> Key: PIG-2076
> URL: https://issues.apache.org/jira/browse/PIG-2076
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
> Attachments: PIG-2076.1.patch
>
>
> The default value of pig.cachedbag.memusage was changed to 0.2 in pig 0.8, as 
> part of changes in PIG-1447 .
> But the help command and documentation shows older default value of 0.1 .

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Pig-trunk-commit #815

2011-05-16 Thread Apache Jenkins Server

See 

Changes:

[thejas] PIG-2072: NPE when udf has project-star argument and input schema is 
null

--
[...truncated 5561 lines...]
  [javadoc] Loading source files for package 
org.apache.pig.backend.datastorage...
  [javadoc] Loading source files for package 
org.apache.pig.backend.executionengine...
  [javadoc] Loading source files for package org.apache.pig.backend.hadoop...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.datastorage...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.regex...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.physicalLayer.util...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.executionengine.util...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.hbase...
  [javadoc] Loading source files for package 
org.apache.pig.backend.hadoop.streaming...
  [javadoc] Loading source files for package org.apache.pig.builtin...
  [javadoc] Loading source files for package org.apache.pig.classification...
  [javadoc] Loading source files for package org.apache.pig.data...
  [javadoc] Loading source files for package org.apache.pig.impl...
  [javadoc] Loading source files for package org.apache.pig.impl.builtin...
  [javadoc] Loading source files for package org.apache.pig.impl.io...
  [javadoc] Loading source files for package org.apache.pig.impl.logicalLayer...
  [javadoc] Loading source files for package 
org.apache.pig.impl.logicalLayer.schema...
  [javadoc] Loading source files for package 
org.apache.pig.impl.logicalLayer.validators...
  [javadoc] Loading source files for package org.apache.pig.impl.plan...
  [javadoc] Loading source files for package 
org.apache.pig.impl.plan.optimizer...
  [javadoc] Loading source files for package org.apache.pig.impl.streaming...
  [javadoc] Loading source files for package org.apache.pig.impl.util...
  [javadoc] Loading source files for package org.apache.pig.newplan...
  [javadoc] Loading source files for package org.apache.pig.newplan.logical...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.expression...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.optimizer...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.relational...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.rules...
  [javadoc] Loading source files for package 
org.apache.pig.newplan.logical.visitor...
  [javadoc] Loading source files for package org.apache.pig.newplan.optimizer...
  [javadoc] Loading source files for package org.apache.pig.parser...
  [javadoc] Loading source files for package org.apache.pig.pen...
  [javadoc] Loading source files for package org.apache.pig.pen.util...
  [javadoc] Loading source files for package org.apache.pig.scripting...
  [javadoc] Loading source files for package org.apache.pig.scripting.js...
  [javadoc] Loading source files for package org.apache.pig.scripting.jython...
  [javadoc] Loading source files for package org.apache.pig.tools...
  [javadoc] Loading source files for package org.apache.pig.tools.cmdline...
  [javadoc] Loading source files for package org.apache.pig.tools.grunt...
  [javadoc] Loading source files for package org.apache.pig.tools.parameters...
  [javadoc] Loading source files for package org.apache.pig.tools.pigstats...
  [javadoc] Loading source files for package org.apache.pig.tools.streams...
  [javadoc] Loading source files for package org.apache.pig.tools.timer...
  [javadoc] Constructing Javadoc information...
  [javadoc] Standard Doclet version 1.6.0_23
  [javadoc] Building tree for all the packages and classes...
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...

javadoc-jar:
  [jar] Building jar:

[jira] [Resolved] (PIG-2072) NPE when udf has project-star argument and input schema is null

2011-05-16 Thread Thejas M Nair (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair resolved PIG-2072.


Resolution: Fixed

Unit test and test-patch passed. Patch committed to trunk and 0.9 branch.


> NPE when udf has project-star argument and input schema is null
> ---
>
> Key: PIG-2072
> URL: https://issues.apache.org/jira/browse/PIG-2072
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.9.0
>
> Attachments: PIG-2072.1.patch
>
>
> {code}
> grunt> l = load 'x' ; 
> grunt> f = foreach l generate CONCAT(*);
> 2011-05-13 12:04:48,355 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 
> 2999: Unexpected internal error. null
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2029) Inconsistency in Pig Stats reports

[jira] [Updated] (PIG-1824) Support import modules in Jython UDF

Re: New DOAP file for Pig Project

Build failed in Jenkins: Pig-trunk-commit #818

[jira] [Resolved] (PIG-2070) "Unknown" appears in error message for an error case

[jira] [Resolved] (PIG-2071) casting numeric type to chararray during schema merge for union is inconsistent with other schema merge cases

New DOAP file for Pig Project

Build failed in Jenkins: Pig-trunk-commit #817

[jira] [Commented] (PIG-2070) "Unknown" appears in error message for an error case

[jira] [Commented] (PIG-2071) casting numeric type to chararray during schema merge for union is inconsistent with other schema merge cases

[jira] [Resolved] (PIG-2069) LoadFunc jar does not ship to backend in MultiQuery case

Build failed in Jenkins: Pig-trunk-commit #816

[jira] [Updated] (PIG-2071) casting numeric type to chararray during schema merge for union is inconsistent with other schema merge cases

[jira] [Updated] (PIG-2070) "Unknown" appears in error message for an error case

[jira] [Resolved] (PIG-2076) update documentation, help command with correct default value of pig.cachedbag.memusage

Build failed in Jenkins: Pig-trunk-commit #815

[jira] [Resolved] (PIG-2072) NPE when udf has project-star argument and input schema is null

17 matches

Site Navigation

Mail list logo

Footer information