[jira] [Commented] (PIG-2207) Support custom counters for aggregating warnings from different udfs

2011-08-09 Thread Dmitriy V. Ryaboy (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082137#comment-13082137
 ] 

Dmitriy V. Ryaboy commented on PIG-2207:


Your proposal suggests custom counters via strings, so we have this problem 
either way. At least making the group match the class that issues the warning 
constrains the space of possible counters to num_udfs x 4_generic_warnings, 
whereas the space of possible strings is (for our purposes) unlimited.

> Support custom counters for aggregating warnings from different udfs
> 
>
> Key: PIG-2207
> URL: https://issues.apache.org/jira/browse/PIG-2207
> Project: Pig
>  Issue Type: Improvement
>Reporter: Thejas M Nair
>  Labels: newbie
> Fix For: 0.10
>
>
> Pig allows udfs to aggregate warning messages instead of writing out a 
> separate warning message each time. Udfs can do this by logging the warning 
> using EvalFunc.warn(String msg, Enum) call. But the udfs are forced to use 
> PigWarning class if the warning needs to be printed at the end of the pig 
> script . 
> For example, with the changes in PIG-2191, some of the builtin udfs are using 
> PigWarning.UDF_WARNING_1 as argument in calls to EvalFunc.warn. This will 
> result in the warning count being printed on STDERR -
> {code}
> 2011-08-05 22:10:29,285 [main] WARN  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Encountered Warning UDF_WARNING_1 2 time(s).
> 2011-08-05 22:10:29,285 [main] INFO  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Success!
> {code}
> But it would be better if a udf such as the LOWER udf could use a custom 
> warning counter, and the STDERR is like -
> {code}
> 2011-08-05 22:10:29,285 [main] WARN  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Encountered Warning LOWER_FUNC_INPUT_WARNING 2 time(s).
> 2011-08-05 22:10:29,285 [main] INFO  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Success!
> {code}
> A new function could be added to support this - (something like) 
> EvalFunc.warn(String warnName, String warnMsg);  A specific counter group 
> could be used for udf warnings (see org.apache.hadoop.mapred.Counters), and 
> counters for that group could be done during final warning aggregation in 
> done in MapReduceLauncher.computeWarningAggregate(). 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2183) Pig not working with Hadoop 0.20.203.0

2011-08-09 Thread Daniel Dai (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated PIG-2183:


Attachment: PIG-2183-2.patch

> Pig not working with Hadoop 0.20.203.0
> --
>
> Key: PIG-2183
> URL: https://issues.apache.org/jira/browse/PIG-2183
> Project: Pig
>  Issue Type: Bug
>  Components: grunt, site
>Affects Versions: 0.8.1, 0.9.1, 0.10
> Environment: Gentoo Linux Kernel: 2.6.38-gentoo-r6
> java version "1.6.0_26"
> Ant version 1.8.1
>Reporter: John Lium
>Assignee: Daniel Dai
> Attachments: PIG-2183-1.patch, PIG-2183-2.patch
>
>
> When running pig, I get the following error.
> Error before Pig is launched
> 
> ERROR 2999: Unexpected internal error. Failed to create DataStorage
> java.lang.RuntimeException: Failed to create DataStorage
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.(HDataStorage.java:58)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134)
>   at org.apache.pig.impl.PigContext.connect(PigContext.java:183)
>   at org.apache.pig.PigServer.(PigServer.java:226)
>   at org.apache.pig.PigServer.(PigServer.java:215)
>   at org.apache.pig.tools.grunt.Grunt.(Grunt.java:55)
>   at org.apache.pig.Main.run(Main.java:452)
>   at org.apache.pig.Main.main(Main.java:107)
> Caused by: java.io.IOException: Call to rasputin/192.168.1.3:9000 failed on 
> local exception: java.io.EOFException
>   at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>   at org.apache.hadoop.ipc.Client.call(Client.java:743)
>   at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>   at $Proxy0.getProtocolVersion(Unknown Source)
>   at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>   at 
> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:207)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:170)
>   at 
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
>   at 
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
>   at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>   at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)
>   ... 9 more
> Caused by: java.io.EOFException
>   at java.io.DataInputStream.readInt(DataInputStream.java:375)
>   at 
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
>   at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
> 
> My env vars are defined in bin/pig as the following
> export JAVA_HOME="/etc/java-config-2/current-system-vm"
> export 
> PIG_CLASSPATH="/var/hadoop/pig/pig-withouthadoop.jar:$HADOOP_HOME/hadoop-core-0.20.203.0.jar:$HADOOP_HOME/lib:$HADOOP_CONF_DIR"

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2183) Pig not working with Hadoop 0.20.203.0

2011-08-09 Thread Daniel Dai (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated PIG-2183:


Attachment: (was: PIG-2183-2.patch)

> Pig not working with Hadoop 0.20.203.0
> --
>
> Key: PIG-2183
> URL: https://issues.apache.org/jira/browse/PIG-2183
> Project: Pig
>  Issue Type: Bug
>  Components: grunt, site
>Affects Versions: 0.8.1, 0.9.1, 0.10
> Environment: Gentoo Linux Kernel: 2.6.38-gentoo-r6
> java version "1.6.0_26"
> Ant version 1.8.1
>Reporter: John Lium
>Assignee: Daniel Dai
> Attachments: PIG-2183-1.patch
>
>
> When running pig, I get the following error.
> Error before Pig is launched
> 
> ERROR 2999: Unexpected internal error. Failed to create DataStorage
> java.lang.RuntimeException: Failed to create DataStorage
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.(HDataStorage.java:58)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134)
>   at org.apache.pig.impl.PigContext.connect(PigContext.java:183)
>   at org.apache.pig.PigServer.(PigServer.java:226)
>   at org.apache.pig.PigServer.(PigServer.java:215)
>   at org.apache.pig.tools.grunt.Grunt.(Grunt.java:55)
>   at org.apache.pig.Main.run(Main.java:452)
>   at org.apache.pig.Main.main(Main.java:107)
> Caused by: java.io.IOException: Call to rasputin/192.168.1.3:9000 failed on 
> local exception: java.io.EOFException
>   at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>   at org.apache.hadoop.ipc.Client.call(Client.java:743)
>   at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>   at $Proxy0.getProtocolVersion(Unknown Source)
>   at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>   at 
> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:207)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:170)
>   at 
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
>   at 
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
>   at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>   at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)
>   ... 9 more
> Caused by: java.io.EOFException
>   at java.io.DataInputStream.readInt(DataInputStream.java:375)
>   at 
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
>   at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
> 
> My env vars are defined in bin/pig as the following
> export JAVA_HOME="/etc/java-config-2/current-system-vm"
> export 
> PIG_CLASSPATH="/var/hadoop/pig/pig-withouthadoop.jar:$HADOOP_HOME/hadoop-core-0.20.203.0.jar:$HADOOP_HOME/lib:$HADOOP_CONF_DIR"

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2183) Pig not working with Hadoop 0.20.203.0

2011-08-09 Thread Daniel Dai (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated PIG-2183:


Attachment: PIG-2183-2.patch

> Pig not working with Hadoop 0.20.203.0
> --
>
> Key: PIG-2183
> URL: https://issues.apache.org/jira/browse/PIG-2183
> Project: Pig
>  Issue Type: Bug
>  Components: grunt, site
>Affects Versions: 0.8.1, 0.9.1, 0.10
> Environment: Gentoo Linux Kernel: 2.6.38-gentoo-r6
> java version "1.6.0_26"
> Ant version 1.8.1
>Reporter: John Lium
>Assignee: Daniel Dai
> Attachments: PIG-2183-1.patch, PIG-2183-2.patch
>
>
> When running pig, I get the following error.
> Error before Pig is launched
> 
> ERROR 2999: Unexpected internal error. Failed to create DataStorage
> java.lang.RuntimeException: Failed to create DataStorage
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.(HDataStorage.java:58)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134)
>   at org.apache.pig.impl.PigContext.connect(PigContext.java:183)
>   at org.apache.pig.PigServer.(PigServer.java:226)
>   at org.apache.pig.PigServer.(PigServer.java:215)
>   at org.apache.pig.tools.grunt.Grunt.(Grunt.java:55)
>   at org.apache.pig.Main.run(Main.java:452)
>   at org.apache.pig.Main.main(Main.java:107)
> Caused by: java.io.IOException: Call to rasputin/192.168.1.3:9000 failed on 
> local exception: java.io.EOFException
>   at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>   at org.apache.hadoop.ipc.Client.call(Client.java:743)
>   at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>   at $Proxy0.getProtocolVersion(Unknown Source)
>   at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>   at 
> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:207)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:170)
>   at 
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
>   at 
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
>   at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>   at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)
>   ... 9 more
> Caused by: java.io.EOFException
>   at java.io.DataInputStream.readInt(DataInputStream.java:375)
>   at 
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
>   at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
> 
> My env vars are defined in bin/pig as the following
> export JAVA_HOME="/etc/java-config-2/current-system-vm"
> export 
> PIG_CLASSPATH="/var/hadoop/pig/pig-withouthadoop.jar:$HADOOP_HOME/hadoop-core-0.20.203.0.jar:$HADOOP_HOME/lib:$HADOOP_CONF_DIR"

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2183) Pig not working with Hadoop 0.20.203.0

2011-08-09 Thread Daniel Dai (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated PIG-2183:


Attachment: (was: PIG-2183-2.patch)

> Pig not working with Hadoop 0.20.203.0
> --
>
> Key: PIG-2183
> URL: https://issues.apache.org/jira/browse/PIG-2183
> Project: Pig
>  Issue Type: Bug
>  Components: grunt, site
>Affects Versions: 0.8.1, 0.9.1, 0.10
> Environment: Gentoo Linux Kernel: 2.6.38-gentoo-r6
> java version "1.6.0_26"
> Ant version 1.8.1
>Reporter: John Lium
>Assignee: Daniel Dai
> Attachments: PIG-2183-1.patch, PIG-2183-2.patch
>
>
> When running pig, I get the following error.
> Error before Pig is launched
> 
> ERROR 2999: Unexpected internal error. Failed to create DataStorage
> java.lang.RuntimeException: Failed to create DataStorage
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.(HDataStorage.java:58)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134)
>   at org.apache.pig.impl.PigContext.connect(PigContext.java:183)
>   at org.apache.pig.PigServer.(PigServer.java:226)
>   at org.apache.pig.PigServer.(PigServer.java:215)
>   at org.apache.pig.tools.grunt.Grunt.(Grunt.java:55)
>   at org.apache.pig.Main.run(Main.java:452)
>   at org.apache.pig.Main.main(Main.java:107)
> Caused by: java.io.IOException: Call to rasputin/192.168.1.3:9000 failed on 
> local exception: java.io.EOFException
>   at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>   at org.apache.hadoop.ipc.Client.call(Client.java:743)
>   at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>   at $Proxy0.getProtocolVersion(Unknown Source)
>   at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>   at 
> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:207)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:170)
>   at 
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
>   at 
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
>   at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>   at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)
>   ... 9 more
> Caused by: java.io.EOFException
>   at java.io.DataInputStream.readInt(DataInputStream.java:375)
>   at 
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
>   at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
> 
> My env vars are defined in bin/pig as the following
> export JAVA_HOME="/etc/java-config-2/current-system-vm"
> export 
> PIG_CLASSPATH="/var/hadoop/pig/pig-withouthadoop.jar:$HADOOP_HOME/hadoop-core-0.20.203.0.jar:$HADOOP_HOME/lib:$HADOOP_CONF_DIR"

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2183) Pig not working with Hadoop 0.20.203.0

2011-08-09 Thread Daniel Dai (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated PIG-2183:


Attachment: PIG-2183-2.patch

PIG-2183-2.patch include some bug fix, also change undesired behavior 
introduced by PIG-1857.

> Pig not working with Hadoop 0.20.203.0
> --
>
> Key: PIG-2183
> URL: https://issues.apache.org/jira/browse/PIG-2183
> Project: Pig
>  Issue Type: Bug
>  Components: grunt, site
>Affects Versions: 0.8.1, 0.9.1, 0.10
> Environment: Gentoo Linux Kernel: 2.6.38-gentoo-r6
> java version "1.6.0_26"
> Ant version 1.8.1
>Reporter: John Lium
>Assignee: Daniel Dai
> Attachments: PIG-2183-1.patch, PIG-2183-2.patch
>
>
> When running pig, I get the following error.
> Error before Pig is launched
> 
> ERROR 2999: Unexpected internal error. Failed to create DataStorage
> java.lang.RuntimeException: Failed to create DataStorage
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.(HDataStorage.java:58)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134)
>   at org.apache.pig.impl.PigContext.connect(PigContext.java:183)
>   at org.apache.pig.PigServer.(PigServer.java:226)
>   at org.apache.pig.PigServer.(PigServer.java:215)
>   at org.apache.pig.tools.grunt.Grunt.(Grunt.java:55)
>   at org.apache.pig.Main.run(Main.java:452)
>   at org.apache.pig.Main.main(Main.java:107)
> Caused by: java.io.IOException: Call to rasputin/192.168.1.3:9000 failed on 
> local exception: java.io.EOFException
>   at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>   at org.apache.hadoop.ipc.Client.call(Client.java:743)
>   at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>   at $Proxy0.getProtocolVersion(Unknown Source)
>   at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>   at 
> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:207)
>   at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:170)
>   at 
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
>   at 
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
>   at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>   at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>   at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
>   at 
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72)
>   ... 9 more
> Caused by: java.io.EOFException
>   at java.io.DataInputStream.readInt(DataInputStream.java:375)
>   at 
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
>   at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
> 
> My env vars are defined in bin/pig as the following
> export JAVA_HOME="/etc/java-config-2/current-system-vm"
> export 
> PIG_CLASSPATH="/var/hadoop/pig/pig-withouthadoop.jar:$HADOOP_HOME/hadoop-core-0.20.203.0.jar:$HADOOP_HOME/lib:$HADOOP_CONF_DIR"

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Pig-trunk-commit #878

2011-08-09 Thread Apache Jenkins Server 
See 

Changes:

[gkesavan] Fix tools location

--
[...truncated 2087 lines...]
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroRecordReader.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroSchema2Pig.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigSchema2Avro.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorage.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageUtils.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageLog.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/XMLLoader.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition/PathPartitionHelper.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition/PathPartitioner.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Decode.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Bin.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/BinCond.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ExtremalTupleByNthField.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/MaxTupleBy1stField.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtract.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LcFirst.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Trim.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/REPLACE.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Reverse.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/HashFNV1.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UcFirst.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/HashFNV2.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LASTINDEXOF.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/SUBSTRING.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LENGTH.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LookupInFiles.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexMatch.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LOWER.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Split.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/INDEXOF.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/HashFNV.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtractAll.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/IntMax.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatNextup.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatRound.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleMax.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/IntAbs.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/LOG.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/MAX.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatSignum.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/pigg

Build failed in Jenkins: Pig-trunk #1057

2011-08-09 Thread Apache Jenkins Server 
See 

Changes:

[gkesavan] Fix java installation location

[gkesavan] Add jenkins tools installation script

[thejas] PIG-2090:re-enable TestGrunt test cases (previous checkin)
fixing CHANGES.txt - used incorrect jira number (PIG-1907) in previous checkin

[thejas] PIG-1907: replace use of TupleFactory.newTupleNoCopy(List) with
 newTuple(List) in some of the physical operators

[daijy] PIG-1631: Support to 2 level nested foreach

[gkesavan] Fix mr279 build without changing version setting

[gkesavan] Fix mr279 builds without changing version setting

[thejas] adding hadoop20 shim dirs to eclipse classpath

[dvryaboy] PIG-2191: Reduce amount of log spam generated by UDFs

[daijy] PIG-2181: Improvement : for error message when describe misses alias

[daijy] PIG-2124: Script never ending when joining from the same source

[gkesavan] Update mr-279 build

[gkesavan] Update the hudson env with latest path info

[thejas] PIG-2170: NPE thrown during illustrate

[olga] Jdiff change for 0.9.0

[dvryaboy] PIG-2200: Piggybank cannot be built from the Git mirror

[daijy] PIG-2199: Penny throws Exception when netty classes are missing

[daijy] PIG-2013: Penny gets a null pointer when no properties are set

--
[...truncated 2094 lines...]
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageInputStream.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroRecordReader.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroSchema2Pig.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigSchema2Avro.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorage.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageUtils.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageLog.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/XMLLoader.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition/PathPartitionHelper.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition/PathPartitioner.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Decode.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Bin.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/BinCond.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ExtremalTupleByNthField.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/MaxTupleBy1stField.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtract.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LcFirst.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Trim.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/REPLACE.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Reverse.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/HashFNV1.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UcFirst.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/HashFNV2.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LASTINDEXOF.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/SUBSTRING.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LENGTH.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LookupInFiles.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexMatch.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LOWER.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Split.java
A 
contrib/pig

Build failed in Jenkins: Pig-trunk-commit #877

2011-08-09 Thread Apache Jenkins Server 
See 

Changes:

[gkesavan] Fix java installation location

[gkesavan] Add jenkins tools installation script

[thejas] PIG-2090:re-enable TestGrunt test cases (previous checkin)
fixing CHANGES.txt - used incorrect jira number (PIG-1907) in previous checkin

[thejas] PIG-1907: replace use of TupleFactory.newTupleNoCopy(List) with
 newTuple(List) in some of the physical operators

[daijy] PIG-1631: Support to 2 level nested foreach

[gkesavan] Fix mr279 build without changing version setting

[gkesavan] Fix mr279 builds without changing version setting

[thejas] adding hadoop20 shim dirs to eclipse classpath

[dvryaboy] PIG-2191: Reduce amount of log spam generated by UDFs

[daijy] PIG-2181: Improvement : for error message when describe misses alias

[daijy] PIG-2124: Script never ending when joining from the same source

[gkesavan] Update mr-279 build

[gkesavan] Update the hudson env with latest path info

[thejas] PIG-2170: NPE thrown during illustrate

[olga] Jdiff change for 0.9.0

[dvryaboy] PIG-2200: Piggybank cannot be built from the Git mirror

[daijy] PIG-2199: Penny throws Exception when netty classes are missing

[daijy] PIG-2013: Penny gets a null pointer when no properties are set

--
[...truncated 2100 lines...]
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageInputStream.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroRecordReader.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroSchema2Pig.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigSchema2Avro.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorage.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageUtils.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageLog.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/XMLLoader.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition/PathPartitionHelper.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/partition/PathPartitioner.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Decode.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Bin.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/BinCond.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ExtremalTupleByNthField.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/MaxTupleBy1stField.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtract.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LcFirst.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Trim.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/REPLACE.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Reverse.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/HashFNV1.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UcFirst.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/HashFNV2.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LASTINDEXOF.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/SUBSTRING.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LENGTH.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LookupInFiles.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexMatch.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LOWER.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java
A 
contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Split.java
A 
contr

[jira] [Commented] (PIG-2207) Support custom counters for aggregating warnings from different udfs

2011-08-09 Thread Thejas M Nair (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082003#comment-13082003
 ] 

Thejas M Nair commented on PIG-2207:


It will not be a good idea for udfs to use separate counters until the next-gen 
mapreduce is in (MR-279). A large number of counters can cause the the job to 
be killed, for hadoop 0.20.x (see MAPREDUCE-1943). MR-279 will enable much 
larger number of counters to be used.


> Support custom counters for aggregating warnings from different udfs
> 
>
> Key: PIG-2207
> URL: https://issues.apache.org/jira/browse/PIG-2207
> Project: Pig
>  Issue Type: Improvement
>Reporter: Thejas M Nair
>  Labels: newbie
> Fix For: 0.10
>
>
> Pig allows udfs to aggregate warning messages instead of writing out a 
> separate warning message each time. Udfs can do this by logging the warning 
> using EvalFunc.warn(String msg, Enum) call. But the udfs are forced to use 
> PigWarning class if the warning needs to be printed at the end of the pig 
> script . 
> For example, with the changes in PIG-2191, some of the builtin udfs are using 
> PigWarning.UDF_WARNING_1 as argument in calls to EvalFunc.warn. This will 
> result in the warning count being printed on STDERR -
> {code}
> 2011-08-05 22:10:29,285 [main] WARN  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Encountered Warning UDF_WARNING_1 2 time(s).
> 2011-08-05 22:10:29,285 [main] INFO  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Success!
> {code}
> But it would be better if a udf such as the LOWER udf could use a custom 
> warning counter, and the STDERR is like -
> {code}
> 2011-08-05 22:10:29,285 [main] WARN  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Encountered Warning LOWER_FUNC_INPUT_WARNING 2 time(s).
> 2011-08-05 22:10:29,285 [main] INFO  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Success!
> {code}
> A new function could be added to support this - (something like) 
> EvalFunc.warn(String warnName, String warnMsg);  A specific counter group 
> could be used for udf warnings (see org.apache.hadoop.mapred.Counters), and 
> counters for that group could be done during final warning aggregation in 
> done in MapReduceLauncher.computeWarningAggregate(). 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (PIG-2209) JsonMetadata fails to find schema for glob paths

2011-08-09 Thread Dmitriy V. Ryaboy (JIRA) 
JsonMetadata fails to find schema for glob paths


 Key: PIG-2209
 URL: https://issues.apache.org/jira/browse/PIG-2209
 Project: Pig
  Issue Type: Bug
Affects Versions: 0.10
Reporter: Dmitriy V. Ryaboy
Assignee: Dmitriy V. Ryaboy


JsonMetadata, used in PigStorage to work with serialized schemas, does not 
correctly interpret paths like '/foo/bar/{1,2,3}' and throws an exception:

{code}
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1131: 
Could not find schema file for file:///foo/bar/{1,2}
at 
org.apache.pig.builtin.JsonMetadata.nullOrException(JsonMetadata.java:217)
at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:186)
at org.apache.pig.builtin.PigStorage.getSchema(PigStorage.java:438)
at 
org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:150)
... 17 more
Caused by: java.io.IOException: Unable to read file:///foo/bar/z/{1,2}
at 
org.apache.pig.builtin.JsonMetadata.findMetaFile(JsonMetadata.java:106)
at org.apache.pig.builtin.JsonMetadata.getSchema(JsonMetadata.java:183)
... 19 more
Caused by: java.net.URISyntaxException: Illegal character in path at index 36: 
file:///foo/bar/{1,2}
at java.net.URI$Parser.fail(URI.java:2809)
at java.net.URI$Parser.checkChars(URI.java:2982)
{code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2208) Restrict number of PIG generated Haddop counters

2011-08-09 Thread Dmitriy V. Ryaboy (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081990#comment-13081990
 ] 

Dmitriy V. Ryaboy commented on PIG-2208:


Can I propose that in addition to the above, we augment the grammar of store 
and load funcs with a "with [no]counters"?

Sometimes you know which relations you care about and which you do not.

> Restrict number of PIG generated Haddop counters 
> -
>
> Key: PIG-2208
> URL: https://issues.apache.org/jira/browse/PIG-2208
> Project: Pig
>  Issue Type: Bug
>  Components: impl
>Affects Versions: 0.8.1, 0.9.0
>Reporter: Richard Ding
>Assignee: Richard Ding
> Fix For: 0.9.1
>
>
> PIG 8.0 implemented Hadoop counters to track the number of records read for 
> each input and the number of records written for each output (PIG-1389 & 
> PIG-1299). On the other hand, Hadoop has imposed limit on per job counters 
> (MAPREDUCE-1943) and jobs will fail if the counters exceed the limit.
> Therefore we need a way to cap the number of PIG generated counters.
> Here are the two options:
> 1. Add a integer property (e.g., pig.counter.limit) to the pig property file 
> (e.g., 20). If the number of inputs of a job exceeds this number, the input 
> counters are disabled. Similarly, if the number of outputs of a job exceeds 
> this number, the output counters are disabled.
> 2. Add a boolean property (e.g., pig.disable.counters) to the pig property 
> file (default: false). If this property is set to true, then the PIG 
> generated counters are disabled.
>   

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (PIG-2208) Restrict number of PIG generated Haddop counters

2011-08-09 Thread Richard Ding (JIRA) 
Restrict number of PIG generated Haddop counters 
-

 Key: PIG-2208
 URL: https://issues.apache.org/jira/browse/PIG-2208
 Project: Pig
  Issue Type: Bug
  Components: impl
Affects Versions: 0.9.0, 0.8.1
Reporter: Richard Ding
Assignee: Richard Ding
 Fix For: 0.9.1


PIG 8.0 implemented Hadoop counters to track the number of records read for 
each input and the number of records written for each output (PIG-1389 & 
PIG-1299). On the other hand, Hadoop has imposed limit on per job counters 
(MAPREDUCE-1943) and jobs will fail if the counters exceed the limit.

Therefore we need a way to cap the number of PIG generated counters.

Here are the two options:

1. Add a integer property (e.g., pig.counter.limit) to the pig property file 
(e.g., 20). If the number of inputs of a job exceeds this number, the input 
counters are disabled. Similarly, if the number of outputs of a job exceeds 
this number, the output counters are disabled.

2. Add a boolean property (e.g., pig.disable.counters) to the pig property file 
(default: false). If this property is set to true, then the PIG generated 
counters are disabled.

  



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2126) Pig doc need to describe how to load complex data for PigStorage

2011-08-09 Thread Olga Natkovich (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081835#comment-13081835
 ] 

Olga Natkovich commented on PIG-2126:
-

Corinne, please, take a look. We want the to go into both 0.9 branch as well as 
into the trunk, thanks

> Pig doc need to describe how to load complex data for PigStorage
> 
>
> Key: PIG-2126
> URL: https://issues.apache.org/jira/browse/PIG-2126
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.9.1, 0.10
>Reporter: Daniel Dai
>Assignee: Corinne Chandel
> Fix For: 0.9.1, 0.10
>
>
> Need to describe how to load bag, tuple, map

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (PIG-2126) Pig doc need to describe how to load complex data for PigStorage

2011-08-09 Thread Olga Natkovich (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Olga Natkovich reassigned PIG-2126:
---

Assignee: Corinne Chandel  (was: Olga Natkovich)

> Pig doc need to describe how to load complex data for PigStorage
> 
>
> Key: PIG-2126
> URL: https://issues.apache.org/jira/browse/PIG-2126
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.9.1, 0.10
>Reporter: Daniel Dai
>Assignee: Corinne Chandel
> Fix For: 0.9.1, 0.10
>
>
> Need to describe how to load bag, tuple, map

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2090) re-enable TestGrunt test cases

2011-08-09 Thread Thejas M Nair (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081830#comment-13081830
 ] 

Thejas M Nair commented on PIG-2090:


Patch committed to trunk.

> re-enable TestGrunt test cases
> --
>
> Key: PIG-2090
> URL: https://issues.apache.org/jira/browse/PIG-2090
> Project: Pig
>  Issue Type: Task
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.10
>
> Attachments: PIG-2090.1.patch
>
>
> Some test cases in TestGrunt.java were commented out in PIG-928. But it seems 
> to have been done by mistake. I re-enabled a few of the working ones as part 
> of changes in PIG-2084. The rest of them should be fixed, or if what they 
> test is no longer valid they should be removed from the test file . 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2090) re-enable TestGrunt test cases

2011-08-09 Thread Thejas M Nair (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair updated PIG-2090:
---

Resolution: Fixed
Status: Resolved  (was: Patch Available)

> re-enable TestGrunt test cases
> --
>
> Key: PIG-2090
> URL: https://issues.apache.org/jira/browse/PIG-2090
> Project: Pig
>  Issue Type: Task
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.10
>
> Attachments: PIG-2090.1.patch
>
>
> Some test cases in TestGrunt.java were commented out in PIG-928. But it seems 
> to have been done by mistake. I re-enabled a few of the working ones as part 
> of changes in PIG-2084. The rest of them should be fixed, or if what they 
> test is no longer valid they should be removed from the test file . 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2090) re-enable TestGrunt test cases

2011-08-09 Thread Daniel Dai (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081822#comment-13081822
 ] 

Daniel Dai commented on PIG-2090:
-

+1

> re-enable TestGrunt test cases
> --
>
> Key: PIG-2090
> URL: https://issues.apache.org/jira/browse/PIG-2090
> Project: Pig
>  Issue Type: Task
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.10
>
> Attachments: PIG-2090.1.patch
>
>
> Some test cases in TestGrunt.java were commented out in PIG-928. But it seems 
> to have been done by mistake. I re-enabled a few of the working ones as part 
> of changes in PIG-2084. The rest of them should be fixed, or if what they 
> test is no longer valid they should be removed from the test file . 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (PIG-2126) Pig doc need to describe how to load complex data for PigStorage

2011-08-09 Thread Corinne Chandel (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Corinne Chandel reassigned PIG-2126:


Assignee: Olga Natkovich  (was: Corinne Chandel)

> Pig doc need to describe how to load complex data for PigStorage
> 
>
> Key: PIG-2126
> URL: https://issues.apache.org/jira/browse/PIG-2126
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.9.1, 0.10
>Reporter: Daniel Dai
>Assignee: Olga Natkovich
> Fix For: 0.9.1, 0.10
>
>
> Need to describe how to load bag, tuple, map

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2126) Pig doc need to describe how to load complex data for PigStorage

2011-08-09 Thread Daniel Dai (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated PIG-2126:


Affects Version/s: 0.9.1
Fix Version/s: 0.9.1
 Assignee: Corinne Chandel
 Release Note: 
Document is here:
https://cwiki.apache.org/confluence/display/PIG/Load+complex+data+using+PigStorage

> Pig doc need to describe how to load complex data for PigStorage
> 
>
> Key: PIG-2126
> URL: https://issues.apache.org/jira/browse/PIG-2126
> Project: Pig
>  Issue Type: Improvement
>Affects Versions: 0.9.1, 0.10
>Reporter: Daniel Dai
>Assignee: Corinne Chandel
> Fix For: 0.9.1, 0.10
>
>
> Need to describe how to load bag, tuple, map

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2090) re-enable TestGrunt test cases

2011-08-09 Thread Thejas M Nair (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair updated PIG-2090:
---

Status: Patch Available  (was: Open)

> re-enable TestGrunt test cases
> --
>
> Key: PIG-2090
> URL: https://issues.apache.org/jira/browse/PIG-2090
> Project: Pig
>  Issue Type: Task
>Affects Versions: 0.9.0, 0.8.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.10
>
> Attachments: PIG-2090.1.patch
>
>
> Some test cases in TestGrunt.java were commented out in PIG-928. But it seems 
> to have been done by mistake. I re-enabled a few of the working ones as part 
> of changes in PIG-2084. The rest of them should be fixed, or if what they 
> test is no longer valid they should be removed from the test file . 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2090) re-enable TestGrunt test cases

2011-08-09 Thread Thejas M Nair (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair updated PIG-2090:
---

Attachment: PIG-2090.1.patch

PIG-2090.1.patch - enables the tests that were commented out. test-patch and 
test cases pass.


> re-enable TestGrunt test cases
> --
>
> Key: PIG-2090
> URL: https://issues.apache.org/jira/browse/PIG-2090
> Project: Pig
>  Issue Type: Task
>Affects Versions: 0.8.0, 0.9.0
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.10
>
> Attachments: PIG-2090.1.patch
>
>
> Some test cases in TestGrunt.java were commented out in PIG-928. But it seems 
> to have been done by mistake. I re-enabled a few of the working ones as part 
> of changes in PIG-2084. The rest of them should be fixed, or if what they 
> test is no longer valid they should be removed from the test file . 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-1429) Add Boolean Data Type to Pig

2011-08-09 Thread Zhijie Shen (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhijie Shen updated PIG-1429:
-

Attachment: PIG-1429_3.patch

Hi,

The newly attached patch is ready for submission.

In this patch, I've updated the logic of converting String to Boolean according 
to Thejas's and Daniel's comments, added boolean comparator for sorting by 
boolean column, unified the type name of Boolean to "bool", and modified some 
other minor issues. Additionally, I've added the test cases.

Please have me to verify the patch. Thanks indeed!

> Add Boolean Data Type to Pig
> 
>
> Key: PIG-1429
> URL: https://issues.apache.org/jira/browse/PIG-1429
> Project: Pig
>  Issue Type: New Feature
>  Components: data
>Affects Versions: 0.7.0
>Reporter: Russell Jurney
>Assignee: Zhijie Shen
>  Labels: boolean, gsoc2011, pig, type
> Attachments: PIG-1429_1.patch, PIG-1429_2.patch, PIG-1429_3.patch, 
> working_boolean.patch
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Pig needs a Boolean data type.  Pig-1097 is dependent on doing this.  
> I volunteer.  Is there anything beyond the work in src/org/apache/pig/data/ 
> plus unit tests to make this work?  
> This is a candidate project for Google summer of code 2011. More information 
> about the program can be found at http://wiki.apache.org/pig/GSoc2011

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira