<mailto:user@spark.apache.org>
<mailto:user@spark.apache.org
<mailto:user@spark.apache.org>>
<mailto:user@spark.apache.org
<mailto:user@spark.apache.org>
<mailto:user@spark.apache.org
ache.org>
<mailto:user@spark.apache.org
<mailto:user@spark.apache.org>>>
Cc:
Date: Thu, 15 Oct 2015 08:03:55 +0200
Subject: Re: Spark 1.5 Streaming and Kinesis
:user@spark.apache.org
<mailto:user@spark.apache.org>>>
Cc:
Date: Thu, 15 Oct 2015 08:03:55 +0200
Subject: Re: Spark 1.5 Streaming and
Kinesis
Hi Phil,
also when I try
>> to run the spark streaming kinesis example that comes in
>> spark/examples
>>
>> Tried running the streaming job locally, and also in EMR
>> with release
>> 4.1
lso in EMR with release
>> 4.1.0 that includes Spark 1.5
>>
>> Very strange!
>>
>> -- Forwarded message --
>>
>> From: "Jean-Baptiste Onofré" <j...@nanthrax.net <mailto:j...@nanthrax.net
>> >>
>>
: "Jean-Baptiste Onofré" <j...@nanthrax.net>
> To: user@spark.apache.org
> Cc:
> Date: Thu, 15 Oct 2015 08:03:55 +0200
> Subject: Re: Spark 1.5 Streaming and Kinesis
> Hi Phil,
> KinesisReceiver is part of extra. Just a dumb question: did you update
> all, including th
ark.apache.org>
Cc:
Date: Thu, 15 Oct 2015 08:03:55 +0200
Subject: Re: Spark 1.5 Streaming and Kinesis
Hi Phil,
KinesisReceiver is part of extra. Just a dumb question: did you
update all, including the Spark Kinesis extra containing the
KinesisReceiver ?
I c
t;> Tried running the streaming job locally, and also in EMR with release
>>> 4.1.0 that includes Spark 1.5
>>>
>>> Very strange!
>>>
>>> -- Forwarded message --
>>>
>>> From: "Jean-Baptiste Onofré" &
er@spark.apache.org
<mailto:user@spark.apache.org>>
Cc:
Date: Thu, 15 Oct 2015 08:03:55 +0200
Subject: Re: Spark 1.5 Streaming and Kinesis
Hi Phil,
KinesisReceiver is
I try
>>>> to run the spark streaming kinesis example that comes in spark/examples
>>>>
>>>> Tried running the streaming job locally, and also in EMR with release
>>>> 4.1.0 that includes Spark 1.5
>>>>
>>>> Very strange!
>&g
Hi Phil,
KinesisReceiver is part of extra. Just a dumb question: did you update
all, including the Spark Kinesis extra containing the KinesisReceiver ?
I checked on tag v1.5.0, and at line 175 of the KinesisReceiver, we see:
blockIdToSeqNumRanges.clear()
which is a:
private val
By correct, I mean: the map declaration looks good to me, so the
ClassCastException is weird ;)
I'm trying to reproduce the issue in order to investigate.
Regards
JB
On 10/15/2015 08:03 AM, Jean-Baptiste Onofré wrote:
Hi Phil,
KinesisReceiver is part of extra. Just a dumb question: did you
Hi,
We are trying to migrate from Spark1.4 to Spark1.5 for our Kinesis
streaming applications, to take advantage of the new Kinesis checkpointing
improvements in 1.5.
However after upgrading, we are consistently seeing the following error:
java.lang.ClassCastException:
13 matches
Mail list logo