yer
>> like HDFS. so I dont know what is a connection between RDD and blocks (I
>> know that for every batch one RDD is produced)? what is a block in this
>> context? is it a disk block ? if so, what is it default size? and Finally,
>> why does the following erro
;
>>>> }
>>>> }).reduceByKey(new Function2<Integer, Integer, Integer>() {
>>>> @Override
>>>> public Integer call(Integer v1, Integer v2) throws
>>>> Exception {
>>>> return v1+v2;
>>>> }
>>>> }).foreachRDD(new VoidFunction<JavaPairRDD<String, Integer>>() {
>>>> @Override
>>>> public void call(JavaPairRDD<String, Integer>
>>>> stringIntegerJavaPairRDD) throws Exception {
>>>> Map<String, Integer> map = new HashMap<>();
>>>> Gson gson = new Gson();
>>>> stringIntegerJavaPairRDD
>>>> .collect()
>>>> .forEach((Tuple2<String, Integer> KV) -> {
>>>> String status = KV._1();
>>>> Integer count = KV._2();
>>>> map.put(status, count);
>>>> }
>>>> );
>>>> NSQReceiver.send(producer, "output_777",
>>>> gson.toJson(map).getBytes());
>>>> }
>>>> });
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> kant
>>>>
>>>>
>>>> On Wed, Nov 30, 2016 at 2:11 PM, Marco Mistroni <mmistr...@gmail.com>
>>>> wrote:
>>>>
>>>>> Could you paste reproducible snippet code?
>>>>> Kr
>>>>>
>>>>> On 30 Nov 2016 9:08 pm, "kant kodali" <kanth...@gmail.com> wrote:
>>>>>
>>>>>> I have lot of these exceptions happening
>>>>>>
>>>>>> java.lang.Exception: Could not compute split, block
>>>>>> input-0-1480539568000 not found
>>>>>>
>>>>>>
>>>>>> Any ideas what this could be?
>>>>>>
>>>>>
>>>>
>>>
>>
>
?
is it a disk block ? if so, what is it default size? and Finally, why does
the following error happens so often?
java.lang.Exception: Could not compute split, block input-0-1480539568000
not found
On Thu, Dec 1, 2016 at 12:42 AM, kant kodali <kanth...@gmail.com> wrote:
> I also use t
Gson gson = new Gson();
>> stringIntegerJavaPairRDD
>> .collect()
>> .forEach((Tuple2<String, Integer> KV) -> {
>> String status = KV._1();
>> Integer count = KV._2();
>> map.put(status, count);
>> }
>> );
>> NSQReceiver.send(producer, "output_777",
>> gson.toJson(map).getBytes());
>> }
>> });
>>
>>
>> Thanks,
>>
>> kant
>>
>>
>> On Wed, Nov 30, 2016 at 2:11 PM, Marco Mistroni <mmistr...@gmail.com>
>> wrote:
>>
>>> Could you paste reproducible snippet code?
>>> Kr
>>>
>>> On 30 Nov 2016 9:08 pm, "kant kodali" <kanth...@gmail.com> wrote:
>>>
>>>> I have lot of these exceptions happening
>>>>
>>>> java.lang.Exception: Could not compute split, block
>>>> input-0-1480539568000 not found
>>>>
>>>>
>>>> Any ideas what this could be?
>>>>
>>>
>>
>
;
> map.put(status, count);
> }
> );
> NSQReceiver.send(producer, "output_777",
> gson.toJson(map).getBytes());
> }
> });
>
>
> Thanks,
>
> kant
>
>
> On Wed, Nov 30, 2016 at 2:11 PM, Marco Mistroni <mmistr...@gmail.com>
> wrote:
>
>> Could you paste reproducible snippet code?
>> Kr
>>
>> On 30 Nov 2016 9:08 pm, "kant kodali" <kanth...@gmail.com> wrote:
>>
>>> I have lot of these exceptions happening
>>>
>>> java.lang.Exception: Could not compute split, block
>>> input-0-1480539568000 not found
>>>
>>>
>>> Any ideas what this could be?
>>>
>>
>
Bytes());
}
});
Thanks,
kant
On Wed, Nov 30, 2016 at 2:11 PM, Marco Mistroni <mmistr...@gmail.com> wrote:
> Could you paste reproducible snippet code?
> Kr
>
> On 30 Nov 2016 9:08 pm, "kant kodali" <kanth...@gmail.com> wrote:
>
>> I have lot of these exceptions happening
>>
>> java.lang.Exception: Could not compute split, block input-0-1480539568000
>> not found
>>
>>
>> Any ideas what this could be?
>>
>
Could you paste reproducible snippet code?
Kr
On 30 Nov 2016 9:08 pm, "kant kodali" <kanth...@gmail.com> wrote:
> I have lot of these exceptions happening
>
> java.lang.Exception: Could not compute split, block input-0-1480539568000
> not found
>
>
> Any ideas what this could be?
>
I have lot of these exceptions happening
java.lang.Exception: Could not compute split, block input-0-1480539568000
not found
Any ideas what this could be?
