[
https://issues.apache.org/jira/browse/PIG-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pi Song resolved PIG-316.
-------------------------
Resolution: Won't Fix
PigStorage doesn't support complex data types so this is an expected behavior.
If you do "store c into ':OUTPATH:';" it should work.
> Error storing aggregate function output
> ---------------------------------------
>
> Key: PIG-316
> URL: https://issues.apache.org/jira/browse/PIG-316
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Pradeep Kamath
> Fix For: types_branch
>
>
> Query which causes error:
> {code}
> a = load ':INPATH:/singlefile/studenttab10k' as (name:chararray, age:int,
> gpa:double);
> b = group a ALL;
> c = foreach b generate SUM(a.age), MIN(a.name), MIN(a.age), MAX(a.name),
> MAX(a.age), AVG(a.age), AVG(a.gpa), COUNT(a.age);
> store b into ':OUTPATH:';
> {code}
> Error:
> {quote}
> 2008-07-14 16:34:44,328 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting
> to hadoop file system at: mytesthost:8020
> 2008-07-14 16:34:44,384 [main] WARN org.apache.hadoop.fs.FileSystem -
> "mytesthost:8020" is a deprecated filesystem name. Use
> "hdfs://mytesthost:8020/" instead.
> 2008-07-14 16:34:44,638 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting
> to map-reduce job tracker at: mytesthost:50020
> 2008-07-14 16:34:44,895 [main] WARN org.apache.hadoop.fs.FileSystem -
> "mytesthost:8020" is a deprecated filesystem name. Use
> "hdfs://mytesthost:8020/" instead.
> store file is
> /user/pig/tests/results/pradeepk.1216078420/Types_7.out:org.apache.pig.builtin.PigStorage
> 2008-07-14 16:34:46,780 [main] WARN org.apache.hadoop.fs.FileSystem -
> "mytesthost:8020" is a deprecated filesystem name. Use
> "hdfs://mytesthost:8020/" instead.
> 2008-07-14 16:34:46,892 [Thread-9] WARN org.apache.hadoop.fs.FileSystem -
> "mytesthost:8020" is a deprecated filesystem name. Use
> "hdfs://mytesthost:8020/" instead.
> 2008-07-14 16:34:47,157 [Thread-9] WARN org.apache.hadoop.fs.FileSystem -
> "mytesthost:8020" is a deprecated filesystem name. Use
> "hdfs://mytesthost:8020/" instead.
> 2008-07-14 16:34:47,357 [main] INFO
> org.apache.pig.impl.mapReduceLayer.Launcher - 0.0% complete
> 2008-07-14 16:34:50,938 [main] INFO
> org.apache.pig.impl.mapReduceLayer.Launcher - 50.0% complete
> 2008-07-14 16:36:02,180 [main] INFO
> org.apache.pig.impl.mapReduceLayer.Launcher - 83.33480060100555% complete
> 2008-07-14 16:36:07,732 [main] INFO
> org.apache.pig.impl.mapReduceLayer.Launcher - Unsuccessful attempt. Completed
> 0.0% of the job
> 2008-07-14 16:36:07,747 [main] ERROR
> org.apache.pig.impl.mapReduceLayer.Launcher - Error message from task (map)
> tip_200807081132_0526_m_000000
> 2008-07-14 16:36:07,750 [main] ERROR
> org.apache.pig.impl.mapReduceLayer.Launcher - Error message from task
> (reduce) tip_200807081132_0526_r_000000 java.io.IOException: Cannot store a
> non-flat tuple using PigStorage
> at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:163)
> at
> org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:117)
> at
> org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
> at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:373)
> at
> org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:154)
> at
> org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:83)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
> java.io.IOException: Cannot store a non-flat tuple using PigStorage
> at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:163)
> at
> org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:117)
> at
> org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
> at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:373)
> at
> org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:154)
>
> at
> org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:83)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
> java.io.IOException: Cannot store a non-flat tuple using PigStorage
> at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:163)
> at
> org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:117)
> at
> org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
> at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:373)
> at
> org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:154)
> at
> org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:83)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
> java.io.IOException: Cannot store a non-flat tuple using PigStorage
> at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:163)
> at
> org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:117)
> at
> org.apache.pig.impl.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
> at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:373)
> at
> org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:154)
> at
> org.apache.pig.impl.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:83)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
> {quote}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
