[ 
https://issues.apache.org/jira/browse/FLINK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371163#comment-16371163
 ] 

ASF GitHub Bot commented on FLINK-6489:
---------------------------------------

Github user zentol commented on the issue:

    https://github.com/apache/flink/pull/5528
  
    I've tried using the start-local.bat scripts and found 2 issues:
    1)
    The following warning is printed in the JobManager and TaskManager windows:
    ```
    WARNING: An illegal reflective access operation has occurred
    WARNING: Illegal reflective access by 
org.apache.hadoop.security.authentication.util.KerberosUtil 
(file:/C:/Users/Zento/Documents/GitHub/flink/flink-dist/target/flink-1.5-SNAPSHOT-bin/flink-1.5-SNAPSHOT/lib/flink-shaded-hadoop2-uber-1.5-SNAPSHOT.jar)
 to method sun.security.krb5.Config.getInstance()
    WARNING: Please consider reporting this to the maintainers of 
org.apache.hadoop.security.authentication.util.KerberosUtil
    WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
    WARNING: All illegal access operations will be denied in a future release
    ```
    2)
    You cannot use them out-of-the-box as they start the old 
JobManager/TaskManager components, but the client works against FLIP-6 by 
default.
    3)
    After explicitly configuring `mode: "old"` in `flink-conf.yaml` the job 
submissions times out. In the JM/TM logs I found this funky exception:
    ```
    2018-02-21 10:44:09,363 ERROR akka.remote.Remoting                          
                - [B cannot be cast to [C
    java.lang.ClassCastException: [B cannot be cast to [C
            at akka.remote.artery.FastHash$.ofString(LruBoundedCache.scala:18)
            at 
akka.remote.serialization.ActorRefResolveCache.hash(ActorRefResolveCache.scala:61)
            at 
akka.remote.serialization.ActorRefResolveCache.hash(ActorRefResolveCache.scala:55)
            at 
akka.remote.artery.LruBoundedCache.getOrCompute(LruBoundedCache.scala:110)
            at 
akka.remote.RemoteActorRefProvider.resolveActorRef(RemoteActorRefProvider.scala:403)
            at akka.actor.SerializedActorRef.readResolve(ActorRef.scala:433)
            at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
            at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown 
Source)
            at java.base/java.lang.reflect.Method.invoke(Unknown Source)
            at java.base/java.io.ObjectStreamClass.invokeReadResolve(Unknown 
Source)
            at java.base/java.io.ObjectInputStream.readOrdinaryObject(Unknown 
Source)
            at java.base/java.io.ObjectInputStream.readObject0(Unknown Source)
            at java.base/java.io.ObjectInputStream.defaultReadFields(Unknown 
Source)
            at java.base/java.io.ObjectInputStream.readSerialData(Unknown 
Source)
            at java.base/java.io.ObjectInputStream.readOrdinaryObject(Unknown 
Source)
            at java.base/java.io.ObjectInputStream.readObject0(Unknown Source)
            at java.base/java.io.ObjectInputStream.readObject(Unknown Source)
            at 
akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:328)
            at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58)
            at 
akka.serialization.JavaSerializer.fromBinary(Serializer.scala:328)
            at 
akka.serialization.Serialization.akka$serialization$Serialization$$deserializeByteArray(Serialization.scala:156)
            at 
akka.serialization.Serialization$$anonfun$deserialize$2.apply(Serialization.scala:142)
            at scala.util.Try$.apply(Try.scala:192)
            at 
akka.serialization.Serialization.deserialize(Serialization.scala:136)
            at 
akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:30)
            at 
akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:64)
            at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:64)
            at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:82)
            at 
akka.remote.EndpointReader$$anonfun$akka$remote$EndpointReader$$deliverAndAck$1.apply(Endpoint.scala:1047)
            at 
akka.remote.EndpointReader$$anonfun$akka$remote$EndpointReader$$deliverAndAck$1.apply(Endpoint.scala:1046)
            at scala.collection.Iterator$class.foreach(Iterator.scala:891)
            at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
            at 
scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
            at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
            at 
akka.remote.EndpointReader.akka$remote$EndpointReader$$deliverAndAck(Endpoint.scala:1046)
            at 
akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:980)
            at akka.actor.Actor$class.aroundReceive(Actor.scala:502)
            at akka.remote.EndpointActor.aroundReceive(Endpoint.scala:446)
            at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)
            at akka.actor.ActorCell.invoke(ActorCell.scala:495)
            at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
            at akka.dispatch.Mailbox.run(Mailbox.scala:224)
            at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
            at 
scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
            at 
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
            at 
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
            at 
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
    ```


> Rework 'start-local.bat' to 'start-local-cluster.bat'
> -----------------------------------------------------
>
>                 Key: FLINK-6489
>                 URL: https://issues.apache.org/jira/browse/FLINK-6489
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Startup Shell Scripts
>            Reporter: Stephan Ewen
>            Assignee: Stephan Ewen
>            Priority: Major
>
> To get rid of the JobManager local mode, we need to make sure that the 
> {{start-local.bat}} script for windows also starts a separate JobManager and 
> TaskManager process, rather than only the JobManager (and relying on that one 
> to spawn a TaskManager)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to