How to solve Unexpected EOS from the reader?

2019-06-27 Thread Daegyu Han
Hi all,

I have tried using TestDFSIO -read, but I have an error and can not resolve it.

The environment I have experimented with is as follows.
Four data nodes and one name node, and a block size of 512MB, and I
wrote 128 files by using TestDFSIO.

I tried to adjust various parameters, but the problem can not be solved.

Why does reading a lot of files cause problems when there are no
problems reading small files?

Errors that occur in attachments are generated in the middle of the map task.

Thank you,
Daegyu

-
To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org
For additional commands, e-mail: user-h...@hadoop.apache.org

Hadoop Community Sync Up Schedule

2019-06-27 Thread Wangda Tan
Hi folks,

Here's the Hadoop Community Sync Up proposal/schedule:
https://docs.google.com/document/d/1GfNpYKhNUERAEH7m3yx6OfleoF3MqoQk3nJ7xqHD9nY/edit#heading=h.xh4zfwj8ppmn

And here's calendar file:

https://calendar.google.com/calendar/ical/hadoop.community.sync.up%40gmail.com/public/basic.ics

We gave it a try this week for YARN+MR and Submarine sync, feedbacks from
participants seems pretty good, lots of new information shared during sync
up, and companies are using/developing Hadoop can better know each other.

Next week there're 4 community sync-ups (Two Submarine for different
timezones, one YARN+MR, one storage), please join to whichever you're
interested:

[image: image.png]

Zoom info and notes can be found in the Google calendar invitation.

Thanks,
Wangda