A difference in how classes are found comes about when running a standalone cluster. You start Spark with the spark/sbin/start-all.sh with only localhost in slaves. Then run the driver “mahout nbtest … -ma spark://Maclaurin.local:7077” or some such.
re: poms, of course—stupid question. On Feb 26, 2015, at 8:19 AM, Andrew Palumbo <[email protected]> wrote: The NB Drivers were working (locally) with the 1.2.1 patch before those deps were added. I haven't tested the drivers since but I did test a script that runs NB from the spark-shell with no problems. I put those in math-scala since all of our scala modules depend on math-scala. On 02/26/2015 11:01 AM, Pat Ferrel wrote: > should these be in all scala poms or just math-scala? > > Is the NB stuff working with the 1.2 branch? > > On Feb 24, 2015, at 1:25 PM, Andrew Palumbo <[email protected]> wrote: > > sorry- I left out the scala-compiler artifact (at the top) it should read: > > <dependency> > <groupId>org.scala-lang</groupId> > <artifactId>scala-compiler</artifactId> > <version>${scala.version}</version> > </dependency> > <dependency> > <groupId>org.scala-lang</groupId> > <artifactId>scala-reflect</artifactId> > <version>${scala.version}</version> > </dependency> > <dependency> > <groupId>org.scala-lang</groupId> > <artifactId>scala-library</artifactId> > <version>${scala.version}</version> > </dependency> > <dependency> > <groupId>org.scala-lang</groupId> > <artifactId>scala-actors</artifactId> > <version>${scala.version}</version> > </dependency> > <dependency> > <groupId>org.scala-lang</groupId> > <artifactId>scalap</artifactId> > <version>${scala.version}</version> > </dependency> > > > > adding these has $mahout spark-shell working for me on spark 1.2.1. > > > > On 02/24/2015 04:20 PM, Andrew Palumbo wrote: >> adding in the following dependencies to the math-scala pom.xml seems to fix >> the problem for me on the old master before the revert/1.2 branch: >> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scala-reflect</artifactId> >> <version>${scala.version}</version> >> </dependency> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scala-library</artifactId> >> <version>${scala.version}</version> >> </dependency> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scala-actors</artifactId> >> <version>${scala.version}</version> >> </dependency> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scalap</artifactId> >> <version>${scala.version}</version> >> </dependency> >> >> >> I dont know if this will help with item-similarity, and doesnt seem to have >> anything to do with the crash that Andrew M. is experiencing on the reverted >> spark-1.1.0 master. >> >> >> >> On 02/24/2015 03:59 PM, Andrew Musselman wrote: >>> Except after some time it blew up: >>> >>> $ bin/mahout spark-shell >>> SLF4J: Class path contains multiple SLF4J bindings. >>> SLF4J: Found binding in >>> [jar:file:/home/akm/mahout/mrlegacy/target/mahout-mrlegacy-1.0-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/home/akm/mahout/spark/target/mahout-spark_2.10-1.0-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/home/akm/spark/assembly/target/scala-2.10/spark-assembly-1.1.1-hadoop1.1.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>> explanation. >>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>> >>> _ _ >>> _ __ ___ __ _| |__ ___ _ _| |_ >>> | '_ ` _ \ / _` | '_ \ / _ \| | | | __| >>> | | | | | | (_| | | | | (_) | |_| | |_ >>> |_| |_| |_|\__,_|_| |_|\___/ \__,_|\__| version 1.0 >>> >>> >>> Using Scala version 2.10.0 (Java HotSpot(TM) 64-Bit Server VM, Java >>> 1.7.0_03) >>> Type in expressions to have them evaluated. >>> Type :help for more information. >>> 15/02/24 12:23:26 WARN Utils: Your hostname, ubuntu resolves to a loopback >>> address: 127.0.1.1; using 5.5.8.1 instead (on interface as0t1) >>> 15/02/24 12:23:26 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to >>> another address >>> 15/02/24 12:23:39 WARN NativeCodeLoader: Unable to load native-hadoop >>> library for your platform... using builtin-java classes where applicable >>> Created spark context.. >>> Mahout distributed context is available as "implicit val sdc". >>> mahout> 15/02/24 12:24:17 ERROR Remoting: >>> org.apache.spark.storage.BlockManagerId; local class incompatible: stream >>> classdesc serialVersionUID = 1677335532749418220, local class >>> serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:24:50 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:25:23 ERROR TaskSchedulerImpl: Lost an executor 0 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:26:00 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:26:33 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:27:06 ERROR TaskSchedulerImpl: Lost an executor 1 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:27:43 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:28:16 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:28:49 ERROR TaskSchedulerImpl: Lost an executor 2 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:29:26 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:29:59 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:30:32 ERROR TaskSchedulerImpl: Lost an executor 3 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:31:09 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:31:42 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:32:15 ERROR TaskSchedulerImpl: Lost an executor 4 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:32:51 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:33:24 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:33:58 ERROR TaskSchedulerImpl: Lost an executor 5 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:34:34 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:35:07 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:35:41 ERROR TaskSchedulerImpl: Lost an executor 6 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:36:17 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:36:50 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:37:23 ERROR TaskSchedulerImpl: Lost an executor 7 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:38:00 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:38:33 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:39:06 ERROR TaskSchedulerImpl: Lost an executor 8 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:39:43 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:40:16 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>> local class incompatible: stream classdesc serialVersionUID = >>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>> at >>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at >>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>> at >>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>> at >>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>> at >>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>> at scala.util.Try$.apply(Try.scala:161) >>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>> at >>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>> at >>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>> at >>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>> at >>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>> at >>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>> at >>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>> 15/02/24 12:40:49 ERROR TaskSchedulerImpl: Lost an executor 9 (already >>> removed): remote Akka client disassociated >>> 15/02/24 12:40:49 ERROR SparkDeploySchedulerBackend: Application has been >>> killed. Reason: Master removed our application: FAILED >>> 15/02/24 12:40:49 ERROR TaskSchedulerImpl: Exiting due to error from >>> cluster scheduler: Master removed our application: FAILED >>> >>> >>> On Tue, Feb 24, 2015 at 12:24 PM, Andrew Musselman < >>> [email protected]> wrote: >>> >>>> Bingo, works off master now; thanks Dmitriy. >>>> >>>> On Tue, Feb 24, 2015 at 11:54 AM, Dmitriy Lyubimov <[email protected]> >>>> wrote: >>>> >>>>> ok spark 1.2 is mirrored now. >>>>> and master should be also ok (back to 1.1) >>>>> >>>>> On Tue, Feb 24, 2015 at 11:53 AM, Andrew Musselman < >>>>> [email protected]> wrote: >>>>> >>>>>> I reset hard to the previous commit, created a branch, and pushed it. >>>>>> >>>>>> I got email confirmation like so: >>>>>> Repository: mahout >>>>>> Updated Branches: >>>>>> refs/heads/spark-1.2 [created] 901ef03b4 >>>>>> >>>>>> On Tue, Feb 24, 2015 at 11:47 AM, Dmitriy Lyubimov <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> yeah ok so you pushed 1.2 branch to asf but it is not yet in github. >>>>> iti >>>>>>> should be there eventually, give it a bit of time. >>>>>>> >>>>>>> On Tue, Feb 24, 2015 at 11:35 AM, Dmitriy Lyubimov <[email protected] >>>>>>> wrote: >>>>>>> >>>>>>>> what exactly did you try to do? >>>>>>>> >>>>>>>> just resetting HEAD will not work on remote branch -- you need >>>>>> force-sync >>>>>>>> that (with +) since it is a history-rewriting push, but asf git does >>>>>> not >>>>>>>> allow that. >>>>>>>> >>>>>>>> ASF will mirror ALL branches afaik. I think i've done it before. so >>>>> if >>>>>>> you >>>>>>>> create a new one it should (eventually) get there. >>>>>>>> >>>>>>>> On Tue, Feb 24, 2015 at 11:18 AM, Andrew Musselman < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Does ASF git get mirrored to GitHub? I tried pushing a branch and >>>>>> don't >>>>>>>>> see it there yet. >>>>>>>>> >>>>>>>>> On Tue, Feb 24, 2015 at 11:16 AM, Dmitriy Lyubimov < >>>>> [email protected] >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> On Tue, Feb 24, 2015 at 10:55 AM, Pat Ferrel < >>>>> [email protected] >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> to be safe I’d “git reset —hard xyz” to the commit previous to >>>>> the >>>>>>>>> 1.2.1 >>>>>>>>>> As i just explained, that resets are not possible with ASF git. >>>>>>>>> Reverting >>>>>>>>>> is the only option. >>>>>>>>>> >>>>>>>>>> -d >>>>>>>>>> >> >
