spark git commit: [SPARK-20217][CORE] Executor should not fail stage if killed task throws non-interrupted exception

2017-04-05 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 4000f128b -> 5142e5d4e [SPARK-20217][CORE] Executor should not fail stage if killed task throws non-interrupted exception ## What changes were proposed in this pull request? If tasks throw non-interrupted exceptions on kill (e.g.

spark git commit: [SPARK-20231][SQL] Refactor star schema code for the subsequent star join detection in CBO

2017-04-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 12206058e -> 4000f128b [SPARK-20231][SQL] Refactor star schema code for the subsequent star join detection in CBO ## What changes were proposed in this pull request? This commit moves star schema code from ```join.scala``` to

spark git commit: [SPARK-20214][ML] Make sure converted csc matrix has sorted indices

2017-04-05 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.0 15ea5eaa2 -> 9016e17af [SPARK-20214][ML] Make sure converted csc matrix has sorted indices ## What changes were proposed in this pull request? `_convert_to_vector` converts a scipy sparse matrix to csc matrix for initializing

spark git commit: [SPARK-20214][ML] Make sure converted csc matrix has sorted indices

2017-04-05 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.1 2b85e059b -> fb81a412e [SPARK-20214][ML] Make sure converted csc matrix has sorted indices ## What changes were proposed in this pull request? `_convert_to_vector` converts a scipy sparse matrix to csc matrix for initializing

spark git commit: [SPARK-20214][ML] Make sure converted csc matrix has sorted indices

2017-04-05 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 9d68c6723 -> 12206058e [SPARK-20214][ML] Make sure converted csc matrix has sorted indices ## What changes were proposed in this pull request? `_convert_to_vector` converts a scipy sparse matrix to csc matrix for initializing

spark git commit: [SPARK-20224][SS] Updated docs for streaming dropDuplicates and mapGroupsWithState

2017-04-05 Thread tdas
Repository: spark Updated Branches: refs/heads/master e2773996b -> 9543fc0e0 [SPARK-20224][SS] Updated docs for streaming dropDuplicates and mapGroupsWithState ## What changes were proposed in this pull request? - Fixed bug in Java API not passing timeout conf to scala API - Updated

spark git commit: [SPARK-19454][PYTHON][SQL] DataFrame.replace improvements

2017-04-05 Thread holden
Repository: spark Updated Branches: refs/heads/master a2d8d767d -> e2773996b [SPARK-19454][PYTHON][SQL] DataFrame.replace improvements ## What changes were proposed in this pull request? - Allows skipping `value` argument if `to_replace` is a `dict`: ```python df =

spark git commit: [SPARK-20223][SQL] Fix typo in tpcds q77.sql

2017-04-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.0 90eb37343 -> 15ea5eaa2 [SPARK-20223][SQL] Fix typo in tpcds q77.sql ## What changes were proposed in this pull request? Fix typo in tpcds q77.sql ## How was this patch tested? N/A Author: wangzhenhua

spark git commit: [SPARK-20223][SQL] Fix typo in tpcds q77.sql

2017-04-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 efc72dcc3 -> 2b85e059b [SPARK-20223][SQL] Fix typo in tpcds q77.sql ## What changes were proposed in this pull request? Fix typo in tpcds q77.sql ## How was this patch tested? N/A Author: wangzhenhua

spark git commit: [SPARK-20223][SQL] Fix typo in tpcds q77.sql

2017-04-05 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 71c3c4815 -> a2d8d767d [SPARK-20223][SQL] Fix typo in tpcds q77.sql ## What changes were proposed in this pull request? Fix typo in tpcds q77.sql ## How was this patch tested? N/A Author: wangzhenhua Closes

spark git commit: [SPARK-19807][WEB UI] Add reason for cancellation when a stage is killed using web UI

2017-04-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6f09dc70d -> 71c3c4815 [SPARK-19807][WEB UI] Add reason for cancellation when a stage is killed using web UI ## What changes were proposed in this pull request? When a user kills a stage using web UI (in Stages page),

spark git commit: [SPARK-20042][WEB UI] Fix log page buttons for reverse proxy mode

2017-04-05 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 00c124884 -> efc72dcc3 [SPARK-20042][WEB UI] Fix log page buttons for reverse proxy mode with spark.ui.reverseProxy=true, full path URLs like /log will point to the master web endpoint which is serving the worker UI as reverse proxy.

spark git commit: [SPARK-20042][WEB UI] Fix log page buttons for reverse proxy mode

2017-04-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master dad499f32 -> 6f09dc70d [SPARK-20042][WEB UI] Fix log page buttons for reverse proxy mode with spark.ui.reverseProxy=true, full path URLs like /log will point to the master web endpoint which is serving the worker UI as reverse proxy. To

spark git commit: [SPARK-20209][SS] Execute next trigger immediately if previous batch took longer than trigger interval

2017-04-05 Thread tdas
Repository: spark Updated Branches: refs/heads/master b6e71032d -> dad499f32 [SPARK-20209][SS] Execute next trigger immediately if previous batch took longer than trigger interval ## What changes were proposed in this pull request? For large trigger intervals (e.g. 10 minutes), if a batch