[spark] branch branch-2.3 updated: [SPARK-26351][MLLIB] Update doc and minor correction in the mllib evaluation metrics

2019-01-20 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new ae64e5b [SPARK-26351][MLLIB] Update doc

[spark] branch branch-2.4 updated: [SPARK-26351][MLLIB] Update doc and minor correction in the mllib evaluation metrics

2019-01-20 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 123adbd [SPARK-26351][MLLIB] Update doc

[spark] branch master updated: [SPARK-26351][MLLIB] Update doc and minor correction in the mllib evaluation metrics

2019-01-20 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9a30e23 [SPARK-26351][MLLIB] Update doc

[spark-website] branch asf-site updated: More minor style fixes for merge script

2019-01-19 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 8b6e7dc More minor style fixes

[spark] branch master updated: [MINOR][TEST] Correct some unit test mistakes

2019-01-19 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ace2364 [MINOR][TEST] Correct some unit test

[spark-website] branch asf-site updated: Tiny cleanup of merge script; use print()

2019-01-18 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new a86525d Tiny cleanup of merge

[spark] branch master updated: [SPARK-26640][CORE][ML][SQL][STREAMING][PYSPARK] Code cleanup from lgtm.com analysis

2019-01-17 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c2d0d70 [SPARK-26640][CORE][ML][SQL][STREAMING

[spark] branch branch-2.3 updated: [SPARK-26638][PYSPARK][ML] Pyspark vector classes always return error for unary negation

2019-01-17 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 8debdbd [SPARK-26638][PYSPARK][ML

[spark] branch branch-2.4 updated: [SPARK-26638][PYSPARK][ML] Pyspark vector classes always return error for unary negation

2019-01-17 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 5a2128c [SPARK-26638][PYSPARK][ML

[spark] branch master updated: [SPARK-26638][PYSPARK][ML] Pyspark vector classes always return error for unary negation

2019-01-17 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0b3abef [SPARK-26638][PYSPARK][ML] Pyspark

[spark] branch master updated: [SPARK-26621][CORE] Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1b575ef5 [SPARK-26621][CORE] Use ConfigEntry

[spark] branch master updated: [SPARK-26457] Show hadoop configurations in HistoryServer environment tab

2019-01-17 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 650b879 [SPARK-26457] Show hadoop

[spark] branch master updated: [MINOR][BUILD] ensure call to translate_component has correct number of arguments

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4915cb3 [MINOR][BUILD] ensure call

[spark] branch master updated: [SPARK-26466][CORE] Use ConfigEntry for hardcoded configs for submit categories.

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 38f0307 [SPARK-26466][CORE] Use ConfigEntry

[spark] branch master updated: [SPARK-26600] Update spark-submit usage message

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 272428d [SPARK-26600] Update spark-submit usage

[spark] branch branch-2.4 updated: [SPARK-26615][CORE] Fixing transport server/client resource leaks in the core unittests

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 22ab94f [SPARK-26615][CORE] Fixing

[spark] branch master updated: [SPARK-26615][CORE] Fixing transport server/client resource leaks in the core unittests

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 819e5ea [SPARK-26615][CORE] Fixing transport

[spark-website] branch asf-site updated: Remove old releases from download page. Remove unused 'stable' flag and old info

2019-01-15 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 31485a3 Remove old releases from

[spark] branch master updated: [SPARK-17928][MESOS] No driver.memoryOverhead setting for mesos cluster mode

2019-01-15 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1b75f3b [SPARK-17928][MESOS

[spark] branch master updated: [SPARK-26462][CORE] Use ConfigEntry for hardcoded configs for execution categories

2019-01-15 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7296999 [SPARK-26462][CORE] Use ConfigEntry

svn commit: r31973 - in /release/spark: spark-2.1.3/ spark-2.2.2/ spark-2.3.1/

2019-01-15 Thread srowen
Author: srowen Date: Tue Jan 15 14:44:15 2019 New Revision: 31973 Log: Remove old Spark releases from dist Removed: release/spark/spark-2.1.3/ release/spark/spark-2.2.2/ release/spark/spark-2.3.1/ - To unsubscribe

svn commit: r31971 - in /dev/spark: 2.4.0-2018_09_15_15_07-1220ab8-bin/ 2.4.0-2018_09_16_00_38-1220ab8-docs/ 2.4.1-SNAPSHOT-2019_01_14_18_37-743dedb-docs/ 3.0.0-SNAPSHOT-2019_01_13_13_55-c01152d-docs/

2019-01-15 Thread srowen
Author: srowen Date: Tue Jan 15 14:42:56 2019 New Revision: 31971 Log: Remove more old Spark doc snapshots from dev Removed: dev/spark/2.4.0-2018_09_15_15_07-1220ab8-bin/ dev/spark/2.4.0-2018_09_16_00_38-1220ab8-docs/ dev/spark/2.4.1-SNAPSHOT-2019_01_14_18_37-743dedb-docs/ dev

[spark] branch branch-2.4 updated: [MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only

2019-01-14 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 743dedb [MINOR][BUILD] Remove binary

[spark] branch master updated: [SPARK-23182][CORE] Allow enabling TCP keep alive on the RPC connections

2019-01-13 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c01152d [SPARK-23182][CORE] Allow enabling TCP

svn commit: r31942 - in /dev/spark: 2.3.1-SNAPSHOT-2018_03_07_14_01-8cd6a96-docs/ 2.3.1-SNAPSHOT-2018_03_07_22_01-404f7e2-docs/ 2.3.1-SNAPSHOT-2018_03_09_06_01-8ff8e16-docs/ 2.3.1-SNAPSHOT-2018_03_09_

2019-01-13 Thread srowen
Author: srowen Date: Sun Jan 13 14:03:23 2019 New Revision: 31942 Log: Remove old Spark docs snapshots from dist/dev Removed: dev/spark/2.3.1-SNAPSHOT-2018_03_07_14_01-8cd6a96-docs/ dev/spark/2.3.1-SNAPSHOT-2018_03_07_22_01-404f7e2-docs/ dev/spark/2.3.1-SNAPSHOT-2018_03_09_06_01

[spark] branch master updated (5b37092 -> 3bd77aa)

2019-01-12 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5b37092 [SPARK-26538][SQL] Set default precision and scale for elements of postgres numeric array add 3bd77aa

[spark] branch master updated: [SPARK-26503][CORE] Get rid of spark.sql.legacy.timeParser.enabled

2019-01-11 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 51a6ba0 [SPARK-26503][CORE] Get rid

[spark-website] branch asf-site updated: Further expand and update the merge and commit process for committers

2019-01-10 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 92606b2 Further expand and update

[spark-website] branch asf-site updated: Update 2018-12-19-spark-ai-summit-apr-2019-agenda-posted.md

2019-01-10 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new b06483a Update 2018-12-19-spark-ai

[spark] branch master updated (6955638 -> 2f8a938)

2019-01-10 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6955638 [SPARK-26459][SQL] replace UpdateNullabilityInAttributeReferences with FixNullability add 2f8a938

[spark] branch master updated: [SPARK-24920][CORE] Allow sharing Netty's memory pool allocators

2019-01-08 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e103c4a [SPARK-24920][CORE] Allow sharing

[spark] branch master updated (72a572f -> b711382)

2019-01-08 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 72a572f [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any add

[spark] branch master updated: [MINOR][K8S] add missing docs for podTemplateContainerName properties

2019-01-07 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5fb5a02 [MINOR][K8S] add missing docs

[spark-website] branch asf-site updated (222263d -> eb0aa14)

2019-01-07 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git. from 63d Hotfix site links in sitemap.xml add eb0aa14 Suggest new Apache repo for committers No new

[spark] branch master updated (a927c764 -> 868e025)

2019-01-07 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a927c764 [SPARK-26559][ML][PYSPARK] ML image can't work with numpy versions prior to 1.9 add 868e025 [SPARK

[spark] branch master updated: [SPARK-26339][SQL] Throws better exception when reading files that start with underscore

2019-01-06 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9d8e9b3 [SPARK-26339][SQL] Throws better

[spark] branch master updated: [SPARK-26527][CORE] Let acquireUnrollMemory fail fast if required space exceeds memory limit

2019-01-06 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 737f089 [SPARK-26527][CORE] Let

[spark] branch master updated: [SPARK-24421][CORE][FOLLOWUP] Use normal direct ByteBuffer allocation if Cleaner can't be set

2019-01-04 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 89cebf4 [SPARK-24421][CORE][FOLLOWUP] Use

[spark] branch master updated: [SPARK-26306][TEST][BUILD] More memory to de-flake SorterSuite

2019-01-04 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 36440e6 [SPARK-26306][TEST][BUILD] More memory

[spark] branch master updated: [SPARK-26517][SQL][TEST] Avoid duplicate test in ParquetSchemaPruningSuite

2019-01-03 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 40711ee [SPARK-26517][SQL][TEST] Avoid

[spark] branch branch-2.4 updated: [SPARK-26501][CORE][TEST] Fix unexpected overriden of exitFn in SparkSubmitSuite

2019-01-03 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new bd6e570 [SPARK-26501][CORE][TEST] Fix

[spark] branch master updated: [SPARK-26501][CORE][TEST] Fix unexpected overriden of exitFn in SparkSubmitSuite

2019-01-03 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 88b074f [SPARK-26501][CORE][TEST] Fix

[spark] branch master updated (4bdfda9 -> d406548)

2019-01-02 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4bdfda9 [SPARK-26507][CORE] Fix core tests for Java 11 add d406548 [SPARK-26277][SQL][TEST] WholeStageCodegen

[spark] branch master updated (79b0548 -> 4bdfda9)

2019-01-02 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 79b0548 [SPARK-26508][CORE][SQL] Address warning messages in Java reported at lgtm.com add 4bdfda9 [SPARK

[spark] branch master updated: [SPARK-26508][CORE][SQL] Address warning messages in Java reported at lgtm.com

2019-01-01 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 79b0548 [SPARK-26508][CORE][SQL] Address

[spark] branch master updated: [SPARK-25765][ML] Add training cost to BisectingKMeans summary

2019-01-01 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 001d309 [SPARK-25765][ML] Add training cost

[spark] branch master updated: [SPARK-24544][SQL] Print actual failure cause when look up function failed

2019-01-01 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2bf4d97 [SPARK-24544][SQL] Print actual failure

[spark] branch master updated: [SPARK-26339][SQL] Throws better exception when reading files that start with underscore

2018-12-31 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c0b9db1 [SPARK-26339][SQL] Throws better

[spark] branch master updated (240817b -> 0996b7c)

2018-12-31 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 240817b [SPARK-26363][WEBUI] Avoid duplicated KV store lookups in method `taskList` add 0996b7c [SPARK-23375

[spark] branch master updated (e6d3e7d -> 240817b)

2018-12-29 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e6d3e7d [SPARK-26443][CORE] Use ConfigEntry for hardcoded configs for history category. add 240817b [SPARK

[spark] branch branch-2.3 updated: [SPARK-26444][WEBUI] Stage color doesn't change with it's status

2018-12-28 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new acbfb31 [SPARK-26444][WEBUI] Stage

[spark] branch branch-2.4 updated: [SPARK-26444][WEBUI] Stage color doesn't change with it's status

2018-12-28 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 4fb3f6d [SPARK-26444][WEBUI] Stage

[spark] branch master updated (f2adb61 -> 5bef4fe)

2018-12-28 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from f2adb61 [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager add 5bef4fe

[spark] branch master updated (0a02d5c -> 90a8103)

2018-12-22 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0a02d5c [SPARK-26285][CORE] accumulator metrics sources for LongAccumulator and Doub… add 90a8103 [SPARK

[spark] branch master updated (7c8f475 -> a888d20)

2018-12-20 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 7c8f475 [SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error add a888d20 [SPARK

[spark] branch branch-2.3 updated: [SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error

2018-12-20 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new a22a11b [SPARK-24687][CORE] Avoid job

[spark] branch branch-2.4 updated: [SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error

2018-12-20 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 74c1cd1 [SPARK-24687][CORE] Avoid job

[spark] branch master updated: [SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error

2018-12-20 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7c8f475 [SPARK-24687][CORE] Avoid job hanging

[spark-website] branch asf-site updated: Hotfix site links in sitemap.xml

2018-12-20 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 63d Hotfix site links

[spark] branch branch-2.3 updated: [SPARK-26394][CORE] Fix annotation error for Utils.timeStringAsMs

2018-12-18 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 832812e4 [SPARK-26394][CORE] Fix

[spark] branch branch-2.4 updated: [SPARK-26394][CORE] Fix annotation error for Utils.timeStringAsMs

2018-12-18 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new f097638 [SPARK-26394][CORE] Fix

[spark] branch master updated: [SPARK-26394][CORE] Fix annotation error for Utils.timeStringAsMs

2018-12-18 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 428eb2a [SPARK-26394][CORE] Fix annotation

[spark] branch master updated (218341c -> 4d693ac)

2018-12-18 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 218341c [SPARK-26081][SQL][FOLLOW-UP] Use foreach instead of misuse of map (for Unit) add 4d693ac [SPARK

[spark] branch master updated (12640d6 -> c04ad17)

2018-12-17 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 12640d6 [SPARK-26243][SQL][FOLLOWUP] fix code style issues in TimestampFormatter.scala add c04ad17 [SPARK

[spark] branch branch-2.3 updated: [SPARK-26315][PYSPARK] auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

2018-12-15 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 20558f7 [SPARK-26315][PYSPARK] auto

[spark] branch master updated: [SPARK-26315][PYSPARK] auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

2018-12-15 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 860f449 [SPARK-26315][PYSPARK] auto cast

[spark] branch branch-2.4 updated: [SPARK-26315][PYSPARK] auto cast threshold from Integer to Float in approxSimilarityJoin of BucketedRandomProjectionLSHModel

2018-12-15 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 869bfc9 [SPARK-26315][PYSPARK] auto

[spark] branch master updated: [MINOR][SQL] Some errors in the notes.

2018-12-14 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d25e443 [MINOR][SQL] Some errors in the notes

[spark] branch master updated (f69998a -> 29b3eb6)

2018-12-13 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from f69998a [MINOR][DOC] update the condition description of BypassMergeSortShuffle add 29b3eb6 [SPARK-26340

[spark] branch master updated: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule

2018-12-13 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f372609 [MINOR][DOC] Fix comments

[spark] branch master updated: [SPARK-24102][ML][MLLIB] ML Evaluators should use weight column - added weight column for regression evaluator

2018-12-12 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 570b8f3 [SPARK-24102][ML][MLLIB] ML Evaluators

[spark] branch master updated: [SPARK-19827][R][FOLLOWUP] spark.ml R API for PIC

2018-12-12 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 79e36e2 [SPARK-19827][R][FOLLOWUP] spark.ml R

[spark] branch branch-2.4 updated: [SPARK-26207][DOC] add PowerIterationClustering (PIC) doc in 2.4 branch

2018-12-10 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 777e129 [SPARK-26207][DOC] add

[spark] branch master updated: [SPARK-19827][R] spark.ml R API for PIC

2018-12-10 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 05cf81e [SPARK-19827][R] spark.ml R API for PIC

[spark] branch master updated: [SPARK-25696] The storage memory displayed on spark Application UI is…

2018-12-10 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 82c1ac4 [SPARK-25696] The storage memory

[spark] branch master updated: This tests pushing directly to github

2018-12-10 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b1a724b This tests pushing directly to github

[spark] branch master updated: This tests pushing to gitbox

2018-12-10 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0bf6c77 This tests pushing to gitbox 0bf6c77

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-12-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22683 In this case the change is simpler to understand in prose, I think; "100 KB" becomes "97.6 KiB", etc. --- ---

[GitHub] spark pull request #23275: [SPARK-26323][SQL] Scala UDF should still check i...

2018-12-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/23275#discussion_r240234573 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala --- @@ -47,25 +47,13 @@ case class ScalaUDF

[GitHub] spark pull request #23275: [SPARK-26323][SQL] Scala UDF should still check i...

2018-12-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/23275#discussion_r240234371 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala --- @@ -47,25 +47,13 @@ case class ScalaUDF

[GitHub] spark issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdo...

2018-12-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23260 Ok, got it. @vanzin or @squito or others would be better able to evaluate. --- - To unsubscribe, e-mail: reviews-unsubscr

[GitHub] spark issue #23072: [SPARK-19827][R]spark.ml R API for PIC

2018-12-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23072 @dongjoon-hyun @felixcheung how about now? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdo...

2018-12-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23260 If you're on YARN, this feels like something you would manage via YARN and its cluster management options. Is there a specific use case here, that this has to happen in Spark

[GitHub] spark issue #23263: [SPARK-23674][ML] Adds Spark ML Events

2018-12-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23263 My first impression is that it's a big change, which is reason for caution here. Visualizing a workflow is nice, but Spark's Pipelines are typically pretty straightforward and linear. I

spark git commit: [SPARK-26283][CORE] Enable reading from open frames of zstd, when reading zstd compressed eventLog

2018-12-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master 877f82cb3 -> ec506bd30 [SPARK-26283][CORE] Enable reading from open frames of zstd, when reading zstd compressed eventLog ## What changes were proposed in this pull request? Root cause: Prior to Spark2.4, When we enable zst for eventLog

[GitHub] spark issue #23241: [SPARK-26283][CORE] Enable reading from open frames of z...

2018-12-09 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23241 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-12-08 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22683 Fortunately the syntax is "100m", which has always meant "100 * 1024 * 1024" or "100 MiB" --- - T

[GitHub] spark pull request #23264: [SPARK-26266][BUILD] Update to Scala 2.12.8 (bran...

2018-12-08 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/23264 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #23264: Update to Scala 2.12.8

2018-12-08 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/23264 Update to Scala 2.12.8 ## What changes were proposed in this pull request? Back-port of https://github.com/apache/spark/pull/23218 ; updates Scala 2.12 build to 2.12.8 ## How

[GitHub] spark issue #23218: [SPARK-26266][BUILD] Update to Scala 2.12.8

2018-12-08 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23218 Merged to master. I'll open a separate PR for branch-2.4 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark pull request #23218: [SPARK-26266][BUILD] Update to Scala 2.12.8

2018-12-08 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/23218 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

spark git commit: [SPARK-26266][BUILD] Update to Scala 2.12.8

2018-12-08 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9b1f6c8ba -> 2ea9792fd [SPARK-26266][BUILD] Update to Scala 2.12.8 ## What changes were proposed in this pull request? Update to Scala 2.12.8 ## How was this patch tested? Existing tests. Closes #23218 from srowen/SPARK-26

[GitHub] spark pull request #23225: [SPARK-26287][CORE]Don't need to create an empty ...

2018-12-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/23225#discussion_r239990036 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -161,6 +161,10 @@ private void writeSortedFile(boolean

[GitHub] spark issue #23256: [SPARK-24207][R] follow-up PR for SPARK-24207 to fix cod...

2018-12-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23256 CC @felixcheung --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #23160: [SPARK-26196][SPARK-26281][WebUI] Total tasks title in t...

2018-12-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23160 Merged to master. @shahidki31 does this need to go in branch 2.4, 2.3? I tried back porting it, but looks like a lot of the affected code didn't exist in 2.4. If the fix can or should also be back

spark git commit: [SPARK-26196][SPARK-26281][WEBUI] Total tasks title in the stage page is incorrect when there are failed or killed tasks and update duration metrics

2018-12-07 Thread srowen
Repository: spark Updated Branches: refs/heads/master bd00f1077 -> 3b8ae2373 [SPARK-26196][SPARK-26281][WEBUI] Total tasks title in the stage page is incorrect when there are failed or killed tasks and update duration metrics ## What changes were proposed in this pull request? This PR fixes

spark git commit: [MINOR][SQL][DOC] Correct parquet nullability documentation

2018-12-07 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9b7679a97 -> bd00f1077 [MINOR][SQL][DOC] Correct parquet nullability documentation ## What changes were proposed in this pull request? Parquet files appear to have nullability info when being written, not being read. ## How was this

[GitHub] spark issue #23247: [SPARK-26294][CORE]Delete Unnecessary If statement

2018-12-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23247 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #17673: [SPARK-20372] [ML] Word2Vec Continuous Bag of Words mode...

2018-12-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17673 @ngopal this one can't be merged as-is and looks like it was abandoned. Would you like to take this PR, update per reviews? I'd review that. I think CBOW could be useful in MLlib

[GitHub] spark issue #23218: [SPARK-26266][BUILD] Update to Scala 2.12.8

2018-12-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23218 I'm not sure. I can't find any other reference to this crash and 2.12.8. It could be something only Spark happens to trigger, or could be specific to this JVM + platform but not Spark or Scala. We

<    15   16   17   18   19   20   21   22   23   24   >