spark git commit: [MINOR][DOC] automatic type inference supports also Date and Timestamp

2017-11-01 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.1 3d6d88996 -> 8b572116f [MINOR][DOC] automatic type inference supports also Date and Timestamp ## What changes were proposed in this pull request? Easy fix in the documentation, which is reporting that only numeric types and string

spark git commit: [MINOR][DOC] automatic type inference supports also Date and Timestamp

2017-11-01 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.2 ab87a92a1 -> c311c5e79 [MINOR][DOC] automatic type inference supports also Date and Timestamp ## What changes were proposed in this pull request? Easy fix in the documentation, which is reporting that only numeric types and string

spark git commit: [MINOR][DOC] automatic type inference supports also Date and Timestamp

2017-11-01 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master d43e1f06b -> b04eefae4 [MINOR][DOC] automatic type inference supports also Date and Timestamp ## What changes were proposed in this pull request? Easy fix in the documentation, which is reporting that only numeric types and string are

spark git commit: [MINOR] Data source v2 docs update.

2017-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1ffe03d9e -> d43e1f06b [MINOR] Data source v2 docs update. ## What changes were proposed in this pull request? This patch includes some doc updates for data source API v2. I was reading the code and noticed some minor issues. ## How was

spark git commit: [SPARK-22190][CORE] Add Spark executor task metrics to Dropwizard metrics

2017-11-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 444bce1c9 -> 1ffe03d9e [SPARK-22190][CORE] Add Spark executor task metrics to Dropwizard metrics ## What changes were proposed in this pull request? This proposed patch is about making Spark executor task metrics available as Dropwizard

spark git commit: [SPARK-19112][CORE] Support for ZStandard codec

2017-11-01 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 07f390a27 -> 444bce1c9 [SPARK-19112][CORE] Support for ZStandard codec ## What changes were proposed in this pull request? Using zstd compression for Spark jobs spilling 100s of TBs of data, we could reduce the amount of data written to

spark git commit: [SPARK-22347][PYSPARK][DOC] Add document to notice users for using udfs with conditional expressions

2017-11-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 96798d14f -> 07f390a27 [SPARK-22347][PYSPARK][DOC] Add document to notice users for using udfs with conditional expressions ## What changes were proposed in this pull request? Under the current execution mode of Python UDFs, we don't

spark git commit: [SPARK-22172][CORE] Worker hangs when the external shuffle service port is already in use

2017-11-01 Thread jshao
Repository: spark Updated Branches: refs/heads/master 556b5d215 -> 96798d14f [SPARK-22172][CORE] Worker hangs when the external shuffle service port is already in use ## What changes were proposed in this pull request? Handling the NonFatal exceptions while starting the external shuffle

spark git commit: [SPARK-5484][FOLLOWUP] PeriodicRDDCheckpointer doc cleanup

2017-11-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 73231860b -> 556b5d215 [SPARK-5484][FOLLOWUP] PeriodicRDDCheckpointer doc cleanup ## What changes were proposed in this pull request? PeriodicRDDCheckpointer was already moved out of mllib in Spark-5484 ## How was this patch tested?