Unexpected data type -1 found in stream.

This leads to the following exception: java.lang.RuntimeException: Unexpected data type -1 found in stream. at org.apache.pig.data.DataReaderWriter.writeDatum(DataReaderWriter.java:306) at org.apache.pig.data.DataReaderWriter.writeDatum(DataReaderWriter.

Unexpected data type -1 found in stream.

at, but something is exploding. Any ideas what it could be? As always, thanks. Here's from grunt: java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 found in stream. at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapRedu

Unexpected data type -1 found in stream

ption: Unexpected data type -1 found in stream. org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias genmap. Backend error : Unable to recreate exception from backed error: java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 fou

Re: Unexpected data type -1 found in stream.

Hi Rakesh, There was some known concern with explicit cast not working when data is complex type (eg: bags). Check PIG-616. It is marked resolved now. As a confirmatory step, you can try removing the explicit cast of chararray and check? Thanks & Regards, /Rekha. On 10/21/10 11:58 AM, "rakesh

RE: Unexpected data type -1 found in stream.

; From: rekha...@yahoo-inc.com > To: user@pig.apache.org; pig-u...@hadoop.apache.org > Date: Thu, 21 Oct 2010 14:19:36 +0530 > Subject: Re: Unexpected data type -1 found in stream. > > Hi Rakesh, > > There was some known concern with explicit cast not working when data is > c

RE: Unexpected data type -1 found in stream.

rg > Subject: RE: Unexpected data type -1 found in stream. > Date: Thu, 21 Oct 2010 11:27:24 -0700 > > > I am using Pig 0.7. No Luck even after removing explicit cast. > > PIG is not able to determine the type of the elements of the map and failing. > I am able to DUMP A and B

Re: Unexpected data type -1 found in stream.

.udf(C.b); > > So It's weird: I'm getting the output I want, it is a DataBag, I output > that, but something is exploding. > > Any ideas what it could be? As always, thanks. > > Here's from grunt: > > java.io

Re: Unexpected data type -1 found in stream.

package squeal.fun; import java.util.Iterator; import java.util.List; import java.util.ArrayList; import java.util.Map; import java.util.HashMap; import java.util.Set; import java.util.HashSet; import java.io.IOException; import org.apache.pig.PigException; import org.apache.pig.backend.executionen

Re: Unexpected data type -1 found in stream.

Thanks Jonathan, your code looks fine. I think there is a bug in the serialization code for bags. >From a quick look, the size of the bag is a long but it is read as an int when comparing bags. Not sure this is the culprit though. I think you should open a Jira for this. -- Gianmarco De Francisci

Re: Unexpected data type -1 found in stream.

I have never really had to raise a bug before, what should I do? Open a ticket, attach the code and the description, and posit that it may be a serialiazable error? It would make me feel so good if there was a bug, though...I've tried to implement some more elegant algebraic versions of things and

Re: Unexpected data type -1 found in stream.

On Jan 26, 2011, at 10:17 AM, Jonathan Coveney wrote: I have never really had to raise a bug before, what should I do? Open a ticket, attach the code and the description, and posit that it may be a serialiazable error? Yes. It would make me feel so good if there was a bug, though...I'v

Re: Unexpected data type -1 found in stream.

Jonathan, did you opened the issue? I'm suffering by the same problem ... Any follow up? On Wed, Jan 26, 2011 at 4:17 PM, Jonathan Coveney wrote: > I have never really had to raise a bug before, what should I do? Open a > ticket, attach the code and the description, and posit that it may be a

Re: Unexpected data type -1 found in stream.

Charles, I did open an issue here: https://issues.apache.org/jira/browse/PIG-1826 It'd be great if you could upload your script and UDF! Hopefully having more vectors will help make it easier to figure out what is going on. 2011/2/10 Charles Gonçalve

Re: Unexpected data type -1 found in stream.

done! I attach the code, script and input data! On Thu, Feb 10, 2011 at 11:39 AM, Jonathan Coveney wrote: > Charles, I did open an issue here: > https://issues.apache.org/jira/browse/PIG-1826 > It'd be great if you could > upload your script and UDF

Re: Unexpected data type -1 found in stream

data type -1 found in stream. org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias genmap. Backend error : Unable to recreate exception from backed error: java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 found i

Re: Unexpected data type -1 found in stream

;> Thanks, >> >> -Xavier >> >> Pig script line: >> >> genmap = FOREACH raw GENERATE >> com.mozilla.pig.eval.json.JsonMap(processed_json) AS >> processed_json_map:map[]; >> >> Log file: >> >> ERROR 2997: Unable to recreate exception from backed error: >&g

Re: Unexpected data type -1 found in stream

t; >> genmap = FOREACH raw GENERATE > >> com.mozilla.pig.eval.json.JsonMap(processed_json) AS > >> processed_json_map:map[]; > >> > >> Log file: > >> > >> ERROR 2997: Unable to recreate exception from backed error: > >> java.io.IOExce

Re: Unexpected data type -1 found in stream

ier >>> >>> Pig script line: >>> >>> genmap = FOREACH raw GENERATE >>> com.mozilla.pig.eval.json.JsonMap(processed_json) AS >>> processed_json_map:map[]; >>> >>> Log file: >>> >>> ERROR 2997: Unable to recreat

Re: Unexpected data type -1 found in stream

ate exception from backed error: java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 found in stream. org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias genmap. Backend error : Unable to recreate exception from backed e

Re: Unexpected data type -1 found in stream

>>>> >>>> Pig script line: >>>> >>>> genmap = FOREACH raw GENERATE >>>> com.mozilla.pig.eval.json.JsonMap(processed_json) AS >>>> processed_json_map:map[]; >>>> >>>> Log file: >>>> >>>> ERROR 2997:

Re: Unexpected data type -1 found in stream

on: java.lang.RuntimeException: Unexpected data type -1 found in stream. org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias genmap. Backend error : Unable to recreate exception from backed error: java.io.IOException: java.lang.RuntimeException: Un

Re: Unexpected data type -1 found in stream

gt;> debug code >>>>>> and I can see the value I get is what I expect and that the >>>>>> resulting >>>>>> map size is 35 elements. Anyone seen a problem like this before? >>>>>> >>>>>> Thanks, >>>>>> >&

Re: Unexpected data type -1 found in stream

xception from backed error: java.io.IOException: java.lang.RuntimeException: Unexpected data type -1 found in stream. org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias genmap. Backend error : Unable to recreate exception from backed error:

Unexpected data type -1 found in stream in PIG-0.8.1-src and Cassandra-0.8-src

using Pig-0.8.1 is throwing below error. "2011-06-23 03:06:58,629 [Thread-13] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local_0001 java.lang.RuntimeException: Unexpected data type -1 found in stream. at org.apache.pig.data.BinInterSedes.writeDatum(BinInterSedes.java:478)

Re: Unexpected data type -1 found in stream in PIG-0.8.1-src and Cassandra-0.8-src

.7.6-2 to > Cassandra-0.8.0 and the cassandra cluster working fine now, but while > reading from cassandra using Pig-0.8.1 is throwing below error. > > "2011-06-23 03:06:58,629 [Thread-13] WARN > org.apache.hadoop.mapred.**LocalJobRunner > - job_local_0001 > java.lang.Run

Re: Unexpected data type -1 found in stream in PIG-0.8.1-src and Cassandra-0.8-src

quot;2011-06-23 03:06:58,629 [Thread-13] WARN org.apache.hadoop.mapred.**LocalJobRunner - job_local_0001 java.lang.RuntimeException: Unexpected data type -1 found in stream. at org.apache.pig.data.**BinInterSedes.writeDatum(** BinInterSedes.java:478) at org.apache.pig.data.**BinInterS