spark git commit: [MINOR][DOC] automatic type inference supports also Date and Timestamp

2017-11-01 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.1 3d6d88996 -> 8b572116f [MINOR][DOC] automatic type inference supports also Date and Timestamp ## What changes were proposed in this pull request? Easy fix in the documentation, which is reporting that only numeric types and string are

spark git commit: [MINOR][DOC] automatic type inference supports also Date and Timestamp

2017-11-01 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.2 ab87a92a1 -> c311c5e79 [MINOR][DOC] automatic type inference supports also Date and Timestamp ## What changes were proposed in this pull request? Easy fix in the documentation, which is reporting that only numeric types and string are

spark git commit: [MINOR][DOC] automatic type inference supports also Date and Timestamp

2017-11-01 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master d43e1f06b -> b04eefae4 [MINOR][DOC] automatic type inference supports also Date and Timestamp ## What changes were proposed in this pull request? Easy fix in the documentation, which is reporting that only numeric types and string are sup

spark git commit: [MINOR] Data source v2 docs update.

2017-11-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1ffe03d9e -> d43e1f06b [MINOR] Data source v2 docs update. ## What changes were proposed in this pull request? This patch includes some doc updates for data source API v2. I was reading the code and noticed some minor issues. ## How was t

spark git commit: [SPARK-22190][CORE] Add Spark executor task metrics to Dropwizard metrics

2017-11-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 444bce1c9 -> 1ffe03d9e [SPARK-22190][CORE] Add Spark executor task metrics to Dropwizard metrics ## What changes were proposed in this pull request? This proposed patch is about making Spark executor task metrics available as Dropwizard m

spark git commit: [SPARK-19112][CORE] Support for ZStandard codec

2017-11-01 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 07f390a27 -> 444bce1c9 [SPARK-19112][CORE] Support for ZStandard codec ## What changes were proposed in this pull request? Using zstd compression for Spark jobs spilling 100s of TBs of data, we could reduce the amount of data written to d

spark git commit: [SPARK-22347][PYSPARK][DOC] Add document to notice users for using udfs with conditional expressions

2017-11-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 96798d14f -> 07f390a27 [SPARK-22347][PYSPARK][DOC] Add document to notice users for using udfs with conditional expressions ## What changes were proposed in this pull request? Under the current execution mode of Python UDFs, we don't well

spark git commit: [SPARK-22172][CORE] Worker hangs when the external shuffle service port is already in use

2017-11-01 Thread jshao
Repository: spark Updated Branches: refs/heads/master 556b5d215 -> 96798d14f [SPARK-22172][CORE] Worker hangs when the external shuffle service port is already in use ## What changes were proposed in this pull request? Handling the NonFatal exceptions while starting the external shuffle serv

spark git commit: [SPARK-5484][FOLLOWUP] PeriodicRDDCheckpointer doc cleanup

2017-11-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 73231860b -> 556b5d215 [SPARK-5484][FOLLOWUP] PeriodicRDDCheckpointer doc cleanup ## What changes were proposed in this pull request? PeriodicRDDCheckpointer was already moved out of mllib in Spark-5484 ## How was this patch tested? existi