Being in a distributed system shouldn't matter too much in this case.
You're worried about two things: mapping your data into byte[], and then
comparing against other data that has been mapped to byte[].
On Fri, Aug 21, 2015 at 1:46 AM, Yaron Gonen yaron.go...@gmail.com wrote:
Thanks for the
Yes, I know how the lease is supposed to work. But it seems that in this
case it's not working as expected. The second client is the only running
client (the previous one having crashed). It fails later, when trying to
append again, with the error:
16:52:
I have an application that continuously appends to an hdfs file and keeps
it open a long time.
At some point the application crashed and left the file open.
It was then restarted and it resumed normal operation, completing some
writes (appending to the file). But, an hour after the crash it
Hey Susheel,
Thanks for the reply. unfortunately those setting didn't help.
Anyhow i found the following related bug:
https://issues.apache.org/jira/browse/YARN-3238
This is fixed in 2.7.0.
Thanks,
-Manoj
On Wed, Aug 19, 2015 at 11:04 PM, Susheel Kumar Gadalay skgada...@gmail.com
wrote:
What is the different between the mappers? Is the input data suppose to go
to all mappers or it is dependent on the source data?
Regards,
Shahab
On Fri, Aug 21, 2015 at 1:35 PM, ☼ R Nair (रविशंकर नायर)
ravishankar.n...@gmail.com wrote:
All,
I have three mappers, followed by a reducer. I
Hi Bogdan!
This is because the second application attempt appears to HDFS as a new client.
Are you sure the second client experienced write errors because *its* lease was
removed?
Yongjun has a great writeup :
http://blog.cloudera.com/blog/2015/02/understanding-hdfs-recovery-processes-part-1/
All,
I have three mappers, followed by a reducer. I executed the map reduce
successfully. The reported output shows that number of mappers executed is
1 and number of reducers is also 1. Though number of reducers are correct,
won't we be getting number of mappers as 3 , since I have three mapper
Thanks for the reply.
How can I guarantee that in a distributed system?
On Wed, Aug 19, 2015 at 8:06 PM, William Slacum wsla...@gmail.com wrote:
In a general sense, if you can guarantee that your objects serialize in
lexicographical order, then you should be able to do a comparator on the
raw
