Xavier Stevens created PIG-2986:
-----------------------------------
Summary: UNION error with bytearrays
Key: PIG-2986
URL: https://issues.apache.org/jira/browse/PIG-2986
Project: Pig
Issue Type: Bug
Affects Versions: 0.9.2
Reporter: Xavier Stevens
I'm trying to do a UNION on two datasets with identical schemas (k:bytearray,
v:chararray). When using the UNION operator like so:
combined_data = UNION dataset1, dataset2;
I get the following error:
java.lang.RuntimeException: Unexpected data type java.util.ArrayList found in
stream. Note only standard Pig type is supported when you output from
UDF/LoadFunc
Everything works fine if I store the two datasets separately without the union.
Here's the full error message from my log file:
ERROR 2999: Unexpected internal error. Unexpected data type java.util.ArrayList
found in stream. Note only standard Pig type is supported when you output from
UDF/LoadFunc
java.lang.RuntimeException: Unexpected data type java.util.ArrayList found in
stream. Note only standard Pig type is supported when you output from
UDF/LoadFunc
at org.apache.pig.data.BinInterSedes.writeDatum(BinInterSedes.java:478)
at org.apache.pig.data.BinInterSedes.writeMap(BinInterSedes.java:500)
at org.apache.pig.data.BinInterSedes.writeDatum(BinInterSedes.java:365)
at org.apache.pig.data.BinInterSedes.writeTuple(BinInterSedes.java:542)
at org.apache.pig.data.BinInterSedes.writeBag(BinInterSedes.java:523)
at org.apache.pig.data.BinInterSedes.writeDatum(BinInterSedes.java:361)
at org.apache.pig.data.BinInterSedes.writeMap(BinInterSedes.java:500)
at org.apache.pig.data.BinInterSedes.writeDatum(BinInterSedes.java:365)
at org.apache.pig.data.BinInterSedes.writeTuple(BinInterSedes.java:542)
at org.apache.pig.data.BinInterSedes.writeDatum(BinInterSedes.java:357)
at
org.apache.pig.impl.io.TFileRecordWriter.write(TFileRecordWriter.java:88)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
