Hi Guys,
When running some cases about spark on mesos, it seemed that spark dispatcher didn't abort when authorization failed. It seemed that spark dispatcher detected the error but did not handle it properly. The detailed log is as below, 16/12/26 16:02:08 INFO Utils: Successfully started service on port 8081. 16/12/26 16:02:08 INFO MesosClusterUI: Bound MesosClusterUI to 0.0.0.0, and started at http://192.168.111.192:8081 I1226 16:02:08.861893 11966 sched.cpp:232] Version: 1.2.0 I1226 16:02:08.868672 11964 sched.cpp:336] New master detected at master@192.168.111.191:5050 I1226 16:02:08.870041 11964 sched.cpp:402] Authenticating with master master@192.168.111.191:5050 I1226 16:02:08.870066 11964 sched.cpp:409] Using default CRAM-MD5 authenticatee I1226 16:02:08.870635 11959 authenticatee.cpp:97] Initializing client SASL I1226 16:02:08.871201 11959 authenticatee.cpp:121] Creating new client SASL connection I1226 16:02:08.971091 11964 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I1226 16:02:08.971156 11964 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I1226 16:02:08.972964 11962 authenticatee.cpp:259] Received SASL authentication step I1226 16:02:08.974642 11957 authenticatee.cpp:299] Authentication success I1226 16:02:08.975075 11964 sched.cpp:508] Successfully authenticated with master master@192.168.111.191:5050 I1226 16:02:08.977557 11960 sched.cpp:1177] Got error 'Not authorized to use role 'spark'' I1226 16:02:08.977583 11960 sched.cpp:2042] Asked to abort the driver 16/12/26 16:02:08 ERROR MesosClusterScheduler: Error received: Not authorized to use role 'spark' I1226 16:02:08.978495 11960 sched.cpp:1223] Aborting framework 16/12/26 16:02:08 INFO MesosClusterScheduler: driver.run() returned with code DRIVER_ABORTED 16/12/26 16:02:08 INFO Utils: Successfully started service on port 7077. 16/12/26 16:02:08 INFO MesosRestServer: Started REST server for submitting applications on port 7077 It seems this is bug. Thanks, Jared, (??) Software developer Interested in open source software, big data, Linux
