Re: EOFException in Hadoop Datanode when writing to Ignite

[Mikhail]

Hi  Rodrigo,

I'm not sure how Flink works, but to write to IGFS you need to use special
implantation of  HDFS:

fs.igfs.impl
org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem
  
  
fs.AbstractFileSystem.igfs.impl
org.apache.ignite.hadoop.fs.v2.IgniteHadoopFileSystem
  

Somehow you need to make Flink to use this implementations, if it uses it's
own implementation it won't work.
I don't know how to configure Flink for this, I think it's a question for
Flink community.

Thanks,
Mikhail.





--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/EOFException-in-Hadoop-Datanode-when-writing-to-Ignite-tp15221p16103.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: EOFException in Hadoop Datanode when writing to Ignite

[Mikhail]

Hi  Rodrigo,

I'm not sure how Flink works, but to write to IGFS you need to use special
implantation of  HDFS:

fs.igfs.impl
org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem
  
  
fs.AbstractFileSystem.igfs.impl
org.apache.ignite.hadoop.fs.v2.IgniteHadoopFileSystem
  

Somehow you need to make Flink to use this implementations, if it uses it's
own implementation it won't work.
I don't know how to configure Flink for this, I think it's a question for
Flink community.

Thanks,
Mikhail.





--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/EOFException-in-Hadoop-Datanode-when-writing-to-Ignite-tp15221p16102.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

EOFException in Hadoop Datanode when writing to Ignite

[Rodrigo Parra]

Hi,

I am trying to run a Flink job that simply writes some data to IGFS (URI:
igfs://igfs@/tmp/output/mydata.bin), as Flink supports custom Hadoop
filesystems [1]. However, I get a timeout error on the job, and looking
further I can find an exception logged by Hadoop's Datanode:

java.io.EOFException: End of File Exception between local host is:
> "cloud-7.mynetwork/130.149.21.11"; destination host is: "cloud-7":45000;
> : java.io.EOFException; For more details see:
> http://wiki.apache.org/hadoop/EOFException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792)
> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:765)
> at org.apache.hadoop.ipc.Client.call(Client.java:1480)
> at org.apache.hadoop.ipc.Client.call(Client.java:1407)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
> at com.sun.proxy.$Proxy14.sendHeartbeat(Unknown Source)
> at
> org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolClientSideTranslatorPB.sendHeartbeat(DatanodeProtocolClientSideTranslatorPB.java:153)
> at
> org.apache.hadoop.hdfs.server.datanode.BPServiceActor.sendHeartBeat(BPServiceActor.java:553)
> at
> org.apache.hadoop.hdfs.server.datanode.BPServiceActor.offerService(BPServiceActor.java:653)
> at
> org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:823)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readInt(DataInputStream.java:392)
> at
> org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1079)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:974)
> 17/07/21 04:33:56 INFO ipc.Client: Retrying connect to server: cloud-7/
> 130.149.21.11:45000. Already tried 0 time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000
> MILLISECONDS)


Ignite is running in PRIMARY mode (as I want to make sure to operate in
memory) and I can use Hadoop CLI tools to query the filesystem (using
bin/hdfs dfs -ls igfs://igfs@/) and write to it  (using bin/hdfs dfs
-copyFromLocal).

I'd appreciate any ideas as to what could cause the write to fail when
doing it programmatically. Thanks in advance.

Best,
Rodrigo



[1]
https://ci.apache.org/projects/flink/flink-docs-release-0.8/example_connectors.html