Re: java.lang.IllegalStateException: unread block data

I found solution. I use HADOOP_MAPRED_HOME in my environment what clashes with spark. After I set empty HADOOP_MAPRED_HOME spark's started working. -- View this message in context:

Hadoop and spark together

Hi, I'm tring to use hadoop and spark togehter but they don't work. If I set HADOOP_MAPRED_HOME to use MRv1 or MRv2 spark stops working. If I set empty HADOOP_MAPRED_HOME to use spark , hadoop stops working. I use cloudera 5.1.3. Best regards, Morbious -- View this message in context: http

Re: java.lang.IllegalStateException: unread block data

Restored ment reboot slave node with unchanged IP. Funny thing is that for small files spark works fine. I checked hadoop with hdfs also and I'm able to run wordcount on it without any problems (i.e. file about 50GB size). -- View this message in context:

Spark optimization

to sp...@spark-s4.test.org:34546 Best regards, Morbious -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-optimization-tp17290.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Spark in cluster and errors

://sparkExecutor@...:53757] Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: spark-master1.domain.org/10.0.6.228:53757 ] I've spent almost a week trying to find solution and the more I dag the more same problems I found. Best regards, Morbious

Re: Spark in cluster [ remote.EndpointWriter: AssociationError]

Sorry, but your solution doesn't work. I can see on my master port 7077 open and listening and connected workers but I don't understand why it's trying to connect itself ... = Master is running on the specific host netstat -at | grep 7077 You will get something similar to: tcp0 0

Spark in cluster [ remote.EndpointWriter: AssociationError]

, Morbious