svn commit: r25751 - in /dev/spark/2.4.0-SNAPSHOT-2018_03_15_20_01-c2632ed-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-03-15 Thread pwendell
Author: pwendell Date: Fri Mar 16 03:15:28 2018 New Revision: 25751 Log: Apache Spark 2.4.0-SNAPSHOT-2018_03_15_20_01-c2632ed docs [This commit notification would consist of 1448 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r25749 - in /dev/spark/2.3.1-SNAPSHOT-2018_03_15_18_01-d9e1f70-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-03-15 Thread pwendell
Author: pwendell Date: Fri Mar 16 01:15:08 2018 New Revision: 25749 Log: Apache Spark 2.3.1-SNAPSHOT-2018_03_15_18_01-d9e1f70 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23670][SQL] Fix memory leak on SparkPlanGraphWrapper

2018-03-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 99f5c0bc7 -> d9e1f7040 [SPARK-23670][SQL] Fix memory leak on SparkPlanGraphWrapper Clean up SparkPlanGraphWrapper objects from InMemoryStore together with cleaning up SQLExecutionUIData existing unit test was extended to check also

spark git commit: [SPARK-23670][SQL] Fix memory leak on SparkPlanGraphWrapper

2018-03-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 3675af724 -> c2632edeb [SPARK-23670][SQL] Fix memory leak on SparkPlanGraphWrapper Clean up SparkPlanGraphWrapper objects from InMemoryStore together with cleaning up SQLExecutionUIData existing unit test was extended to check also

spark git commit: [SPARK-23608][CORE][WEBUI] Add synchronization in SHS between attachSparkUI and detachSparkUI functions to avoid concurrent modification issue to Jetty Handlers

2018-03-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 52a52d5d2 -> 99f5c0bc7 [SPARK-23608][CORE][WEBUI] Add synchronization in SHS between attachSparkUI and detachSparkUI functions to avoid concurrent modification issue to Jetty Handlers Jetty handlers are dynamically attached/detached

spark git commit: [SPARK-23608][CORE][WEBUI] Add synchronization in SHS between attachSparkUI and detachSparkUI functions to avoid concurrent modification issue to Jetty Handlers

2018-03-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 18f8575e0 -> 3675af724 [SPARK-23608][CORE][WEBUI] Add synchronization in SHS between attachSparkUI and detachSparkUI functions to avoid concurrent modification issue to Jetty Handlers Jetty handlers are dynamically attached/detached while

spark git commit: [SPARK-23671][CORE] Fix condition to enable the SHS thread pool.

2018-03-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 2e1e274ed -> 52a52d5d2 [SPARK-23671][CORE] Fix condition to enable the SHS thread pool. Author: Marcelo Vanzin Closes #20814 from vanzin/SPARK-23671. (cherry picked from commit

spark git commit: [SPARK-23671][CORE] Fix condition to enable the SHS thread pool.

2018-03-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 7618896e8 -> 18f8575e0 [SPARK-23671][CORE] Fix condition to enable the SHS thread pool. Author: Marcelo Vanzin Closes #20814 from vanzin/SPARK-23671. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-23658][LAUNCHER] InProcessAppHandle uses the wrong class in getLogger

2018-03-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 72c13ed84 -> 2e1e274ed [SPARK-23658][LAUNCHER] InProcessAppHandle uses the wrong class in getLogger ## What changes were proposed in this pull request? Changed `Logger` in `InProcessAppHandle` to use `InProcessAppHandle` instead of

spark git commit: [SPARK-23658][LAUNCHER] InProcessAppHandle uses the wrong class in getLogger

2018-03-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 15c3c9830 -> 7618896e8 [SPARK-23658][LAUNCHER] InProcessAppHandle uses the wrong class in getLogger ## What changes were proposed in this pull request? Changed `Logger` in `InProcessAppHandle` to use `InProcessAppHandle` instead of

svn commit: r25748 - in /dev/spark/2.3.1-SNAPSHOT-2018_03_15_14_02-72c13ed-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-03-15 Thread pwendell
Author: pwendell Date: Thu Mar 15 21:15:52 2018 New Revision: 25748 Log: Apache Spark 2.3.1-SNAPSHOT-2018_03_15_14_02-72c13ed docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r25746 - in /dev/spark/2.4.0-SNAPSHOT-2018_03_15_12_01-15c3c98-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-03-15 Thread pwendell
Author: pwendell Date: Thu Mar 15 19:15:54 2018 New Revision: 25746 Log: Apache Spark 2.4.0-SNAPSHOT-2018_03_15_12_01-15c3c98 docs [This commit notification would consist of 1448 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory, got 224631

2018-03-15 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 56e8f48a4 -> 15c3c9830 [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory, got 224631 ## What changes were proposed in this pull request?

spark git commit: [SPARK-23695][PYTHON] Fix the error message for Kinesis streaming tests

2018-03-15 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 7c3e8995f -> 56e8f48a4 [SPARK-23695][PYTHON] Fix the error message for Kinesis streaming tests ## What changes were proposed in this pull request? This PR proposes to fix the error message for Kinesis in PySpark when its jar is missing

spark git commit: [SPARK-23695][PYTHON] Fix the error message for Kinesis streaming tests

2018-03-15 Thread ueshin
Repository: spark Updated Branches: refs/heads/branch-2.3 a9d0784e6 -> 72c13ed84 [SPARK-23695][PYTHON] Fix the error message for Kinesis streaming tests ## What changes were proposed in this pull request? This PR proposes to fix the error message for Kinesis in PySpark when its jar is

svn commit: r25722 - in /dev/spark/2.4.0-SNAPSHOT-2018_03_15_04_01-7c3e899-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-03-15 Thread pwendell
Author: pwendell Date: Thu Mar 15 11:17:37 2018 New Revision: 25722 Log: Apache Spark 2.4.0-SNAPSHOT-2018_03_15_04_01-7c3e899 docs [This commit notification would consist of 1448 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23533][SS] Add support for changing ContinuousDataReader's startOffset

2018-03-15 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 4f5bad615 -> 7c3e8995f [SPARK-23533][SS] Add support for changing ContinuousDataReader's startOffset ## What changes were proposed in this pull request? As discussion in #20675, we need add a new interface `ContinuousDataReaderFactory`