it looks like a small thing. please just run tests in spark and mahout-scala modules only (and in spark-shell but i dont think it has any tests there). it should be bearable (as opposed to including math and legacy tests as well). that's what i do. If there are any further unexpected troubles, the CI will flash them out
On Tue, Feb 24, 2015 at 1:40 PM, Andrew Palumbo <[email protected]> wrote: > sure- just looking at it now. I haven't run any tests on it. just running > a script locally to make sure it doesn't crash. Should I do a PR on the 1.2 > branch or just push it? > > > > On 02/24/2015 04:30 PM, Dmitriy Lyubimov wrote: > >> Andrew, perhaps you could commit a patch on top of 1.2 branch? much >> appreciated. >> >> On Tue, Feb 24, 2015 at 1:25 PM, Andrew Palumbo <[email protected]> >> wrote: >> >> sorry- I left out the scala-compiler artifact (at the top) it should >>> read: >>> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scala-compiler</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scala-reflect</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scala-library</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scala-actors</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scalap</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> >>> >>> >>> adding these has $mahout spark-shell working for me on spark 1.2.1. >>> >>> >>> >>> >>> On 02/24/2015 04:20 PM, Andrew Palumbo wrote: >>> >>> adding in the following dependencies to the math-scala pom.xml seems to >>>> fix the problem for me on the old master before the revert/1.2 branch: >>>> >>>> <dependency> >>>> <groupId>org.scala-lang</groupId> >>>> <artifactId>scala-reflect</artifactId> >>>> <version>${scala.version}</version> >>>> </dependency> >>>> <dependency> >>>> <groupId>org.scala-lang</groupId> >>>> <artifactId>scala-library</artifactId> >>>> <version>${scala.version}</version> >>>> </dependency> >>>> <dependency> >>>> <groupId>org.scala-lang</groupId> >>>> <artifactId>scala-actors</artifactId> >>>> <version>${scala.version}</version> >>>> </dependency> >>>> <dependency> >>>> <groupId>org.scala-lang</groupId> >>>> <artifactId>scalap</artifactId> >>>> <version>${scala.version}</version> >>>> </dependency> >>>> >>>> >>>> I dont know if this will help with item-similarity, and doesnt seem to >>>> have anything to do with the crash that Andrew M. is experiencing on the >>>> reverted spark-1.1.0 master. >>>> >>>> >>>> >>>> On 02/24/2015 03:59 PM, Andrew Musselman wrote: >>>> >>>> Except after some time it blew up: >>>>> >>>>> $ bin/mahout spark-shell >>>>> SLF4J: Class path contains multiple SLF4J bindings. >>>>> SLF4J: Found binding in >>>>> [jar:file:/home/akm/mahout/mrlegacy/target/mahout- >>>>> mrlegacy-1.0-SNAPSHOT-job.jar!/org/slf4j/impl/ >>>>> StaticLoggerBinder.class] >>>>> SLF4J: Found binding in >>>>> [jar:file:/home/akm/mahout/spark/target/mahout-spark_2. >>>>> 10-1.0-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>>>> SLF4J: Found binding in >>>>> [jar:file:/home/akm/spark/assembly/target/scala-2.10/ >>>>> spark-assembly-1.1.1-hadoop1.1.1.jar!/org/slf4j/impl/ >>>>> StaticLoggerBinder.class] >>>>> >>>>> >>>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>>>> explanation. >>>>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>>>> >>>>> _ _ >>>>> _ __ ___ __ _| |__ ___ _ _| |_ >>>>> | '_ ` _ \ / _` | '_ \ / _ \| | | | __| >>>>> | | | | | | (_| | | | | (_) | |_| | |_ >>>>> |_| |_| |_|\__,_|_| |_|\___/ \__,_|\__| version 1.0 >>>>> >>>>> >>>>> Using Scala version 2.10.0 (Java HotSpot(TM) 64-Bit Server VM, Java >>>>> 1.7.0_03) >>>>> Type in expressions to have them evaluated. >>>>> Type :help for more information. >>>>> 15/02/24 12:23:26 WARN Utils: Your hostname, ubuntu resolves to a >>>>> loopback >>>>> address: 127.0.1.1; using 5.5.8.1 instead (on interface as0t1) >>>>> 15/02/24 12:23:26 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to >>>>> another address >>>>> 15/02/24 12:23:39 WARN NativeCodeLoader: Unable to load native-hadoop >>>>> library for your platform... using builtin-java classes where >>>>> applicable >>>>> Created spark context.. >>>>> Mahout distributed context is available as "implicit val sdc". >>>>> mahout> 15/02/24 12:24:17 ERROR Remoting: >>>>> org.apache.spark.storage.BlockManagerId; local class incompatible: >>>>> stream >>>>> classdesc serialVersionUID = 1677335532749418220, local class >>>>> serialVersionUID = -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:24:50 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:25:23 ERROR TaskSchedulerImpl: Lost an executor 0 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:26:00 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:26:33 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:27:06 ERROR TaskSchedulerImpl: Lost an executor 1 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:27:43 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:28:16 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:28:49 ERROR TaskSchedulerImpl: Lost an executor 2 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:29:26 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:29:59 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:30:32 ERROR TaskSchedulerImpl: Lost an executor 3 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:31:09 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:31:42 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:32:15 ERROR TaskSchedulerImpl: Lost an executor 4 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:32:51 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:33:24 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:33:58 ERROR TaskSchedulerImpl: Lost an executor 5 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:34:34 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:35:07 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:35:41 ERROR TaskSchedulerImpl: Lost an executor 6 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:36:17 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:36:50 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:37:23 ERROR TaskSchedulerImpl: Lost an executor 7 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:38:00 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:38:33 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:39:06 ERROR TaskSchedulerImpl: Lost an executor 8 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:39:43 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:40:16 ERROR Remoting: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> java.io.InvalidClassException: org.apache.spark.storage. >>>>> BlockManagerId; >>>>> local class incompatible: stream classdesc serialVersionUID = >>>>> 1677335532749418220, local class serialVersionUID = >>>>> -7366074099953117729 >>>>> at java.io.ObjectStreamClass.initNonProxy( >>>>> ObjectStreamClass.java:604) >>>>> at >>>>> java.io.ObjectInputStream.readNonProxyDesc( >>>>> ObjectInputStream.java:1601) >>>>> at java.io.ObjectInputStream.readClassDesc( >>>>> ObjectInputStream.java:1514) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1750) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at >>>>> java.io.ObjectInputStream.defaultReadFields( >>>>> ObjectInputStream.java:1964) >>>>> at java.io.ObjectInputStream.readSerialData( >>>>> ObjectInputStream.java:1888) >>>>> at >>>>> java.io.ObjectInputStream.readOrdinaryObject( >>>>> ObjectInputStream.java:1771) >>>>> >>>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream. >>>>> java:1347) >>>>> at java.io.ObjectInputStream.readObject(ObjectInputStream. >>>>> java:369) >>>>> at >>>>> akka.serialization.JavaSerializer$$anonfun$1. >>>>> apply(Serializer.scala:136) >>>>> at scala.util.DynamicVariable.withValue(DynamicVariable. >>>>> scala:57) >>>>> at akka.serialization.JavaSerializer.fromBinary( >>>>> Serializer.scala:136) >>>>> at >>>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply( >>>>> Serialization.scala:104) >>>>> >>>>> at scala.util.Try$.apply(Try.scala:161) >>>>> at akka.serialization.Serialization.deserialize( >>>>> Serialization.scala:98) >>>>> at >>>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>>> at >>>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint. >>>>> scala:55) >>>>> >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> payload$1(Endpoint.scala:55) >>>>> at akka.remote.DefaultMessageDispatcher. >>>>> dispatch(Endpoint.scala:73) >>>>> at >>>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse( >>>>> Endpoint.scala:764) >>>>> >>>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>>> at >>>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec( >>>>> AbstractDispatcher.scala:386) >>>>> >>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec( >>>>> ForkJoinTask.java:260) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue. >>>>> runTask(ForkJoinPool.java:1339) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker( >>>>> ForkJoinPool.java:1979) >>>>> at >>>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run( >>>>> ForkJoinWorkerThread.java:107) >>>>> >>>>> 15/02/24 12:40:49 ERROR TaskSchedulerImpl: Lost an executor 9 (already >>>>> removed): remote Akka client disassociated >>>>> 15/02/24 12:40:49 ERROR SparkDeploySchedulerBackend: Application has >>>>> been >>>>> killed. Reason: Master removed our application: FAILED >>>>> 15/02/24 12:40:49 ERROR TaskSchedulerImpl: Exiting due to error from >>>>> cluster scheduler: Master removed our application: FAILED >>>>> >>>>> >>>>> On Tue, Feb 24, 2015 at 12:24 PM, Andrew Musselman < >>>>> [email protected]> wrote: >>>>> >>>>> Bingo, works off master now; thanks Dmitriy. >>>>> >>>>>> On Tue, Feb 24, 2015 at 11:54 AM, Dmitriy Lyubimov <[email protected] >>>>>> > >>>>>> wrote: >>>>>> >>>>>> ok spark 1.2 is mirrored now. >>>>>> >>>>>>> and master should be also ok (back to 1.1) >>>>>>> >>>>>>> On Tue, Feb 24, 2015 at 11:53 AM, Andrew Musselman < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>> I reset hard to the previous commit, created a branch, and pushed >>>>>>> it. >>>>>>> >>>>>>>> I got email confirmation like so: >>>>>>>> Repository: mahout >>>>>>>> Updated Branches: >>>>>>>> refs/heads/spark-1.2 [created] 901ef03b4 >>>>>>>> >>>>>>>> On Tue, Feb 24, 2015 at 11:47 AM, Dmitriy Lyubimov < >>>>>>>> [email protected] >>>>>>>> wrote: >>>>>>>> >>>>>>>> yeah ok so you pushed 1.2 branch to asf but it is not yet in >>>>>>>> github. >>>>>>>> iti >>>>>>>> should be there eventually, give it a bit of time. >>>>>>>> >>>>>>>>> On Tue, Feb 24, 2015 at 11:35 AM, Dmitriy Lyubimov < >>>>>>>>> [email protected] >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>> what exactly did you try to do? >>>>>>>>> >>>>>>>>>> just resetting HEAD will not work on remote branch -- you need >>>>>>>>>> >>>>>>>>>> force-sync >>>>>>>>> that (with +) since it is a history-rewriting push, but asf git >>>>>>>>> does >>>>>>>>> not >>>>>>>>> allow that. >>>>>>>>> >>>>>>>>>> ASF will mirror ALL branches afaik. I think i've done it before. >>>>>>>>>> so >>>>>>>>>> >>>>>>>>>> if >>>>>>>>> >>>>>>>> you >>>>>>>> >>>>>>>>> create a new one it should (eventually) get there. >>>>>>>>>> >>>>>>>>>> On Tue, Feb 24, 2015 at 11:18 AM, Andrew Musselman < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>> Does ASF git get mirrored to GitHub? I tried pushing a branch >>>>>>>>>> and >>>>>>>>>> don't >>>>>>>>>> >>>>>>>>> see it there yet. >>>>>>>>> >>>>>>>>>> On Tue, Feb 24, 2015 at 11:16 AM, Dmitriy Lyubimov < >>>>>>>>>>> >>>>>>>>>>> [email protected] >>>>>>>>>> >>>>>>>>> wrote: >>>>>>>> >>>>>>>>> On Tue, Feb 24, 2015 at 10:55 AM, Pat Ferrel < >>>>>>>>>>> [email protected] >>>>>>>>>>> >>>>>>>>>> wrote: >>>>>>>> >>>>>>>>> to be safe I’d “git reset —hard xyz” to the commit previous to >>>>>>>>>>>> the >>>>>>>>>>>> >>>>>>>>>>> 1.2.1 >>>>>>>> >>>>>>>>> As i just explained, that resets are not possible with ASF git. >>>>>>>>>>>> >>>>>>>>>>>> Reverting >>>>>>>>>>> >>>>>>>>>>> is the only option. >>>>>>>>>>>> >>>>>>>>>>>> -d >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>> >
