[GitHub] spark pull request #20642: i m not able to open Spark UI on local using loca...

[AtulKumVerma]

Github user AtulKumVerma closed the pull request at:

https://github.com/apache/spark/pull/20642


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20642: i m not able to open Spark UI on local using loca...

[AtulKumVerma]

GitHub user AtulKumVerma opened a pull request:

https://github.com/apache/spark/pull/20642

i m not able to open Spark UI on local using localhost:4040

20-02-18 20:54:24:118 [WARN] org.spark_project.jetty.server.HttpChannel 
/jobs/ org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:384) 
java.lang.NoSuchMethodError: 
javax.servlet.http.HttpServletRequest.isAsyncStarted()Z
at 
org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:484)
at 
org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at 
org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.spark_project.jetty.server.Server.handle(Server.java:499)
at 
org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at 
org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at 
org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at 
org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at 
org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
20-02-18 20:54:24:122 [WARN] 
org.spark_project.jetty.util.thread.QueuedThreadPool  
org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:610)
 
java.lang.NoSuchMethodError: 
javax.servlet.http.HttpServletResponse.getStatus()I
at 
org.spark_project.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:112)
at org.spark_project.jetty.server.Response.sendError(Response.java:597)
at 
org.spark_project.jetty.server.HttpChannel.handleException(HttpChannel.java:487)
at 
org.spark_project.jetty.server.HttpConnection$HttpChannelOverHttp.handleException(HttpConnection.java:594)
at 
org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:387)
at 
org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at 
org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at 
org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at 
org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/spark branch-2.3

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/20642.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #20642


commit 2db523959658d8cd04f83c176e46f6bcdb745335
Author: sethah 
Date:   2018-01-10T07:32:47Z

[SPARK-22993][ML] Clarify HasCheckpointInterval param doc

## What changes were proposed in this pull request?

Add a note to the `HasCheckpointInterval` parameter doc that clarifies that 
this setting is ignored when no checkpoint directory has been set on the spark 
context.

## How was this patch tested?

No tests necessary, just a doc update.

Author: sethah 

Closes #20188 from sethah/als_checkpoint_doc.

(cherry picked from commit 70bcc9d5ae33d6669bb5c97db29087ccead770fb)
Signed-off-by: Felix Cheung 

commit 60d4d79bb40f13c68773a0224f2003cdca28c138
Author: Josh Rosen 
Date:   2018-01-10T08:45:47Z

[SPARK-22997] Add additional defenses against use of freed MemoryBlocks

## What changes were proposed in this pull request?

This patch modifies Spark's `MemoryAllocator` implementations so that 
`free(MemoryBlock)` mutates the passed block to clear pointers (in the off-heap 
case) or null out references to backing `long[]` arrays (in the on-heap case). 
The goal of this change is to add an extra layer of defense against 
use-after-free bugs because currently it's hard to detect corruption caused by 
blind writes to freed memory blocks.

## How was this patch tested?

New unit tests in `PlatformSuite`, including new tests for existing 
functionality because we did not have sufficient mutation coverage of the 
on-heap memory allocator's pooling logic.

Author: Josh Rosen 

Closes #20191 from 
JoshRosen/SPARK-22997-add-defenses-against-use-after-free-bugs-in-memory-allocator.

(cherry picked from commit f340b6b3066033d40b7e163fd5fb68e9820adfb1)
Signed-off-by: Josh Rosen 

commit 5b5851cb685f395574c94174d45a47c4fbf946c8
Author: Wang Gengliang 
Date:   2018-01-10T17:44:30Z

[SPARK-23019][CORE] Wait until