[GitHub] weixiuli edited a comment on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-19 Thread GitBox
weixiuli edited a comment on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243#issuecomment-448473251 Hi, @dongjoon-hyun ,I have made a new test to test this patch.

[GitHub] felixcheung commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways

2018-12-19 Thread GitBox
felixcheung commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways URL: https://github.com/apache/spark/pull/23337#discussion_r242820273 ## File path: python/pyspark/context.py ## @@ -112,6 +112,18 @@ def __init__(self, master=Non

[GitHub] felixcheung commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways

2018-12-19 Thread GitBox
felixcheung commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways URL: https://github.com/apache/spark/pull/23337#discussion_r242820273 ## File path: python/pyspark/context.py ## @@ -112,6 +112,18 @@ def __init__(self, master=Non

[GitHub] felixcheung commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways

2018-12-19 Thread GitBox
felixcheung commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways URL: https://github.com/apache/spark/pull/23337#discussion_r242820927 ## File path: python/pyspark/context.py ## @@ -112,6 +112,18 @@ def __init__(self, master=Non

[GitHub] felixcheung commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways

2018-12-19 Thread GitBox
felixcheung commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways URL: https://github.com/apache/spark/pull/23337#discussion_r242820927 ## File path: python/pyspark/context.py ## @@ -112,6 +112,18 @@ def __init__(self, master=Non

[GitHub] felixcheung commented on issue #23322: [SPARK-25922][K8] Spark Driver/Executor "spark-app-selector" label mismatch

2018-12-19 Thread GitBox
felixcheung commented on issue #23322: [SPARK-25922][K8] Spark Driver/Executor "spark-app-selector" label mismatch URL: https://github.com/apache/spark/pull/23322#issuecomment-448505428 @liyinan926 if it's non-trivial config, (otherwise you can fix manually in the merge script) it's best t

[GitHub] felixcheung edited a comment on issue #23322: [SPARK-25922][K8] Spark Driver/Executor "spark-app-selector" label mismatch

2018-12-19 Thread GitBox
felixcheung edited a comment on issue #23322: [SPARK-25922][K8] Spark Driver/Executor "spark-app-selector" label mismatch URL: https://github.com/apache/spark/pull/23322#issuecomment-448505428 @liyinan926 if it's non-trivial conflict, (otherwise you can fix manually in the merge script) it

[GitHub] felixcheung commented on a change in pull request #23271: [SPARK-26318][SQL] Deprecate Row.merge

2018-12-19 Thread GitBox
felixcheung commented on a change in pull request #23271: [SPARK-26318][SQL] Deprecate Row.merge URL: https://github.com/apache/spark/pull/23271#discussion_r242821823 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -57,6 +57,8 @@ object Row {

[GitHub] HyukjinKwon commented on issue #23271: [SPARK-26318][SQL] Deprecate Row.merge

2018-12-19 Thread GitBox
HyukjinKwon commented on issue #23271: [SPARK-26318][SQL] Deprecate Row.merge URL: https://github.com/apache/spark/pull/23271#issuecomment-448506659 I think it's okay .. virtually no one uses it .. We could also leave a note when we actually remove it out. It's going to warn that it's depre

[GitHub] rongou commented on issue #23347: allow building spark gpu docker images

2018-12-19 Thread GitBox
rongou commented on issue #23347: allow building spark gpu docker images URL: https://github.com/apache/spark/pull/23347#issuecomment-448507634 I'm mostly following the current structure. There are a few things that can be done to simplify this and lessen the maintenance burden: * As I m

[GitHub] viirya commented on issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data source if it is convertible

2018-12-19 Thread GitBox
viirya commented on issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data source if it is convertible URL: https://github.com/apache/spark/pull/22514#issuecomment-448512628 @cloud-fan Added a SQL config for it.

[GitHub] KyleLi1985 commented on a change in pull request #23271: [SPARK-26318][SQL] Deprecate Row.merge

2018-12-19 Thread GitBox
KyleLi1985 commented on a change in pull request #23271: [SPARK-26318][SQL] Deprecate Row.merge URL: https://github.com/apache/spark/pull/23271#discussion_r242837058 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -57,6 +57,8 @@ object Row {

[GitHub] jomach commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL

2018-12-19 Thread GitBox
jomach commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL URL: https://github.com/apache/spark/pull/23342#issuecomment-448524896 @srowen @felixcheung pr updated This is an automated m

[GitHub] viirya commented on a change in pull request #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF

2018-12-19 Thread GitBox
viirya commented on a change in pull request #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF URL: https://github.com/apache/spark/pull/23308#discussion_r242841630 ## File path: sql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala ## @@ -420,4 +422,32

[GitHub] viirya commented on a change in pull request #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF

2018-12-19 Thread GitBox
viirya commented on a change in pull request #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF URL: https://github.com/apache/spark/pull/23308#discussion_r242841730 ## File path: sql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala ## @@ -420,4 +422,32

[GitHub] HyukjinKwon opened a new pull request #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API

2018-12-19 Thread GitBox
HyukjinKwon opened a new pull request #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API URL: https://github.com/apache/spark/pull/23349 ## What changes were proposed in this pull request? This PR fixes `Literal(..: Any)` can accepts `collection.m

[GitHub] HyukjinKwon commented on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API

2018-12-19 Thread GitBox
HyukjinKwon commented on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API URL: https://github.com/apache/spark/pull/23349#issuecomment-448535079 cc @cloud-fan During checking the codes, I found two things below that I would like to mention

[GitHub] HyukjinKwon edited a comment on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API

2018-12-19 Thread GitBox
HyukjinKwon edited a comment on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API URL: https://github.com/apache/spark/pull/23349#issuecomment-448535079 cc @cloud-fan During checking the codes, I found two things below that I would like to

[GitHub] HyukjinKwon commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline

2018-12-19 Thread GitBox
HyukjinKwon commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline URL: https://github.com/apache/spark/pull/23263#issuecomment-448539534 retest this please This is an automated message from the Apache

[GitHub] HyukjinKwon removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline

2018-12-19 Thread GitBox
HyukjinKwon removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline URL: https://github.com/apache/spark/pull/23263#issuecomment-448539534 retest this please This is an automated message from th

[GitHub] mgaido91 commented on issue #23104: [SPARK-26138][SQL] Cross join requires push LocalLimit in LimitPushDown rule

2018-12-19 Thread GitBox
mgaido91 commented on issue #23104: [SPARK-26138][SQL] Cross join requires push LocalLimit in LimitPushDown rule URL: https://github.com/apache/spark/pull/23104#issuecomment-448542327 @guoxiaolongzte can you address @cloud-fan 's comment? We need the same for InnerLike joins without condit

[GitHub] mgaido91 commented on issue #23315: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False

2018-12-19 Thread GitBox
mgaido91 commented on issue #23315: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23315#issuecomment-448544679 sure, thanks @gatorsmile This is an automate

[GitHub] mgaido91 opened a new pull request #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

2018-12-19 Thread GitBox
mgaido91 opened a new pull request #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23350 ## What changes were proposed in this pull request? In `ReplaceExceptWithFilter` we do not consider proper

[GitHub] mgaido91 commented on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

2018-12-19 Thread GitBox
mgaido91 commented on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23350#issuecomment-448545089 cc @cloud-fan @gatorsmile Thi

[GitHub] MaxGekk commented on issue #23325: [SPARK-26376][SQL] Skip inputs without tokens by JSON datasource

2018-12-19 Thread GitBox
MaxGekk commented on issue #23325: [SPARK-26376][SQL] Skip inputs without tokens by JSON datasource URL: https://github.com/apache/spark/pull/23325#issuecomment-448545158 > always return null if the token is empty, no matter it's row or array or map. In general, returning `null`s fo

[GitHub] cloud-fan commented on issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data source if it is convertible

2018-12-19 Thread GitBox
cloud-fan commented on issue #22514: [SPARK-25271][SQL] Hive ctas commands should use data source if it is convertible URL: https://github.com/apache/spark/pull/22514#issuecomment-448558562 retest this please This is an autom

[GitHub] cloud-fan commented on a change in pull request #22514: [SPARK-25271][SQL] Hive ctas commands should use data source if it is convertible

2018-12-19 Thread GitBox
cloud-fan commented on a change in pull request #22514: [SPARK-25271][SQL] Hive ctas commands should use data source if it is convertible URL: https://github.com/apache/spark/pull/22514#discussion_r242879047 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.s

[GitHub] cloud-fan commented on a change in pull request #23343: [SPARK-26390][SQL] ColumnPruning rule should only do column pruning

2018-12-19 Thread GitBox
cloud-fan commented on a change in pull request #23343: [SPARK-26390][SQL] ColumnPruning rule should only do column pruning URL: https://github.com/apache/spark/pull/23343#discussion_r242883483 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimi

[GitHub] cloud-fan commented on issue #23343: [SPARK-26390][SQL] ColumnPruning rule should only do column pruning

2018-12-19 Thread GitBox
cloud-fan commented on issue #23343: [SPARK-26390][SQL] ColumnPruning rule should only do column pruning URL: https://github.com/apache/spark/pull/23343#issuecomment-448563518 retest this please This is an automated message f

[GitHub] caneGuy commented on issue #21790: [SPARK-24544][SQL] Print actual failure cause when look up function failed

2018-12-19 Thread GitBox
caneGuy commented on issue #21790: [SPARK-24544][SQL] Print actual failure cause when look up function failed URL: https://github.com/apache/spark/pull/21790#issuecomment-448565077 Sorry to bother you @maropu .I tried to add some test case,but i found `SessionCatalogSuite` has test the loo

[GitHub] caneGuy commented on issue #21664: [SPARK-24687][CORE] NoClassDefFoundError will not be catch up which will ca…

2018-12-19 Thread GitBox
caneGuy commented on issue #21664: [SPARK-24687][CORE] NoClassDefFoundError will not be catch up which will ca… URL: https://github.com/apache/spark/pull/21664#issuecomment-448567854 @srowen sorry for replying so late.since i am too busy during the past few months. Since the `NoClassDef

[GitHub] cloud-fan commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2018-12-19 Thread GitBox
cloud-fan commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-448589844 From your benchmark result, it seems the single disk IO is not the major reason for the perf improvement? Do yo

[GitHub] xuanyuanking commented on a change in pull request #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
xuanyuanking commented on a change in pull request #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#discussion_r242946090 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/QueryPlanningTracker.scala ##

[GitHub] imatiach-msft commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

2018-12-19 Thread GitBox
imatiach-msft commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-448626125 jenkins retest this please This is an automated mes

[GitHub] jiangxb1987 commented on issue #21664: [SPARK-24687][CORE] NoClassDefFoundError will not be catch up which may cause job hanging

2018-12-19 Thread GitBox
jiangxb1987 commented on issue #21664: [SPARK-24687][CORE] NoClassDefFoundError will not be catch up which may cause job hanging URL: https://github.com/apache/spark/pull/21664#issuecomment-448627132 In the title you shall describe the changes made, not the current status. `Avoid job hangi

[GitHub] xuanyuanking commented on a change in pull request #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
xuanyuanking commented on a change in pull request #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#discussion_r242952039 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileIndex.scala ##

[GitHub] xuanyuanking commented on a change in pull request #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
xuanyuanking commented on a change in pull request #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#discussion_r242952508 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/metric/SQLMetrics.scala ## @@ -

[GitHub] xuanyuanking commented on a change in pull request #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
xuanyuanking commented on a change in pull request #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#discussion_r242952170 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileIndex.scala ##

[GitHub] cloud-fan opened a new pull request #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
cloud-fan opened a new pull request #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351 ## What changes were proposed in this pull request? A followup of https://github.com/apache/spark/pull/

[GitHub] cloud-fan commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
cloud-fan commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351#issuecomment-448632624 cc @marmbrus @srowen @HyukjinKwon -

[GitHub] cloud-fan commented on issue #23178: [SPARK-26216][SQL] Do not use case class as public API (UserDefinedFunction)

2018-12-19 Thread GitBox
cloud-fan commented on issue #23178: [SPARK-26216][SQL] Do not use case class as public API (UserDefinedFunction) URL: https://github.com/apache/spark/pull/23178#issuecomment-448632891 thanks @marmbrus , that's a good idea! I've updated it in https://github.com/apache/spark/pull/23351 ---

[GitHub] xuanyuanking commented on issue #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
xuanyuanking commented on issue #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#issuecomment-448634140 ``` Can we change the output in UI to show only the time duration, and when hover show both start and end time? ``` Copy, done

[GitHub] srowen commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-19 Thread GitBox
srowen commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#discussion_r242986001 ## File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js ##

[GitHub] squito commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways

2018-12-19 Thread GitBox
squito commented on a change in pull request #23337: [SPARK-26019][PYSPARK] Allow insecure py4j gateways URL: https://github.com/apache/spark/pull/23337#discussion_r242988593 ## File path: python/pyspark/context.py ## @@ -112,6 +112,18 @@ def __init__(self, master=None, ap

[GitHub] gengliangwang opened a new pull request #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions

2018-12-19 Thread GitBox
gengliangwang opened a new pull request #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions URL: https://github.com/apache/spark/pull/23352 ## What changes were proposed in this pull request? Currently the `SQLConf` in `WithTestConf` is not serializable.

[GitHub] gengliangwang commented on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions

2018-12-19 Thread GitBox
gengliangwang commented on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions URL: https://github.com/apache/spark/pull/23352#issuecomment-448673356 @cloud-fan @HyukjinKwon @dongjoon-hyun

[GitHub] gengliangwang commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-19 Thread GitBox
gengliangwang commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#discussion_r243006293 ## File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js

[GitHub] dongjoon-hyun commented on issue #23343: [SPARK-26390][SQL] ColumnPruning rule should only do column pruning

2018-12-19 Thread GitBox
dongjoon-hyun commented on issue #23343: [SPARK-26390][SQL] ColumnPruning rule should only do column pruning URL: https://github.com/apache/spark/pull/23343#issuecomment-448682313 The final commit is only about adding a comment. I'll merge this to master. Thank you all. --

[GitHub] dongjoon-hyun commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
dongjoon-hyun commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351#issuecomment-448683369 Retest this please. This

[GitHub] asfgit closed pull request #23343: [SPARK-26390][SQL] ColumnPruning rule should only do column pruning

2018-12-19 Thread GitBox
asfgit closed pull request #23343: [SPARK-26390][SQL] ColumnPruning rule should only do column pruning URL: https://github.com/apache/spark/pull/23343 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance

[GitHub] AmplabJenkins commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351#issuecomment-448684783 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] rvesse commented on issue #22904: [SPARK-25887][K8S] Configurable K8S context support

2018-12-19 Thread GitBox
rvesse commented on issue #22904: [SPARK-25887][K8S] Configurable K8S context support URL: https://github.com/apache/spark/pull/22904#issuecomment-448684709 @vanzin Finally got round to fixing scala style errors This is an au

[GitHub] AmplabJenkins commented on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23350#issuecomment-448684930 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351#issuecomment-448684778 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins commented on issue #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#issuecomment-448685034 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//j

[GitHub] AmplabJenkins removed a comment on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351#issuecomment-448684778 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins removed a comment on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351#issuecomment-448684783 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] AmplabJenkins commented on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23350#issuecomment-448684926 Merged build finished. Test PASSed. ---

[GitHub] AmplabJenkins commented on issue #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#issuecomment-448685029 Merged build finished. Test PASSed. This is an automated message from

[GitHub] AmplabJenkins commented on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API URL: https://github.com/apache/spark/pull/23349#issuecomment-448685190 Merged build finished. Test PASSed. ---

[GitHub] kiszk commented on a change in pull request #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2018-12-19 Thread GitBox
kiszk commented on a change in pull request #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#discussion_r243014281 ## File path: core/src/main/scala/org/apache/spark/metrics/ExecutorMetricType.scala ## @@ -9

[GitHub] AmplabJenkins commented on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF URL: https://github.com/apache/spark/pull/23308#issuecomment-448685287 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-448685298 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] AmplabJenkins removed a comment on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF URL: https://github.com/apache/spark/pull/23308#issuecomment-448685287 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] AmplabJenkins commented on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF URL: https://github.com/apache/spark/pull/23308#issuecomment-448685278 Merged build finished. Test PASSed. This is an automated m

[GitHub] AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-448685290 Merged build finished. Test PASSed. This i

[GitHub] AmplabJenkins removed a comment on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF URL: https://github.com/apache/spark/pull/23308#issuecomment-448685278 Merged build finished. Test PASSed. This is an aut

[GitHub] AmplabJenkins commented on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API URL: https://github.com/apache/spark/pull/23349#issuecomment-448685196 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] AmplabJenkins commented on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions URL: https://github.com/apache/spark/pull/23352#issuecomment-448685348 Merged build finished. Test PASSed. Thi

[GitHub] AmplabJenkins removed a comment on issue #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#issuecomment-448685029 Merged build finished. Test PASSed. This is an automated messa

[GitHub] AmplabJenkins removed a comment on issue #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#issuecomment-448685034 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] AmplabJenkins commented on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions URL: https://github.com/apache/spark/pull/23352#issuecomment-448685358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] SparkQA commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
SparkQA commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351#issuecomment-448685509 **[Test build #100299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] SparkQA commented on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

2018-12-19 Thread GitBox
SparkQA commented on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23350#issuecomment-448685512 **[Test build #100300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] SparkQA commented on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF

2018-12-19 Thread GitBox
SparkQA commented on issue #23308: [SPARK-26308][SQL] Avoid cast of decimals for ScalaUDF URL: https://github.com/apache/spark/pull/23308#issuecomment-448685573 **[Test build #100303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100303/testReport)** for P

[GitHub] AmplabJenkins removed a comment on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API URL: https://github.com/apache/spark/pull/23349#issuecomment-448685190 Merged build finished. Test PASSed. ---

[GitHub] AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-448685298 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] AmplabJenkins removed a comment on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23350#issuecomment-448684930 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] SparkQA commented on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions

2018-12-19 Thread GitBox
SparkQA commented on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions URL: https://github.com/apache/spark/pull/23352#issuecomment-448685530 **[Test build #100298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100298/t

[GitHub] AmplabJenkins removed a comment on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23350: [SPARK-26366][SQL][BACKPORT-2.3] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23350#issuecomment-448684926 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline URL: https://github.com/apache/spark/pull/23263#issuecomment-448685662 Merged build finished. Test PASSed. This is an automated messa

[GitHub] SparkQA commented on issue #22904: [SPARK-25887][K8S] Configurable K8S context support

2018-12-19 Thread GitBox
SparkQA commented on issue #22904: [SPARK-25887][K8S] Configurable K8S context support URL: https://github.com/apache/spark/pull/22904#issuecomment-448685624 **[Test build #100308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100308/testReport)** for PR 2

[GitHub] SparkQA commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

2018-12-19 Thread GitBox
SparkQA commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-448685707 **[Test build #100312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100312/testReport)**

[GitHub] gatorsmile commented on a change in pull request #23178: [SPARK-26216][SQL] Do not use case class as public API (UserDefinedFunction)

2018-12-19 Thread GitBox
gatorsmile commented on a change in pull request #23178: [SPARK-26216][SQL] Do not use case class as public API (UserDefinedFunction) URL: https://github.com/apache/spark/pull/23178#discussion_r243014617 ## File path: project/MimaExcludes.scala ## @@ -227,7 +227,11 @@ obje

[GitHub] SparkQA commented on issue #23327: [SPARK-26222][SQL] Track file listing time

2018-12-19 Thread GitBox
SparkQA commented on issue #23327: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23327#issuecomment-448685593 **[Test build #100302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100302/testReport)** for PR 23327 at co

[GitHub] SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline

2018-12-19 Thread GitBox
SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline URL: https://github.com/apache/spark/pull/23263#issuecomment-448685577 **[Test build #100306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100306/testReport)** for PR 23

[GitHub] AmplabJenkins removed a comment on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API URL: https://github.com/apache/spark/pull/23349#issuecomment-448685196 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions URL: https://github.com/apache/spark/pull/23352#issuecomment-448685348 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23271: [SPARK-26318][SQL] Deprecate Row.merge

2018-12-19 Thread GitBox
SparkQA commented on issue #23271: [SPARK-26318][SQL] Deprecate Row.merge URL: https://github.com/apache/spark/pull/23271#issuecomment-448685576 **[Test build #100305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100305/testReport)** for PR 23271 at commit

[GitHub] SparkQA commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-19 Thread GitBox
SparkQA commented on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-448685565 **[Test build #100304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100304/test

[GitHub] AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-448685553 Merged build finished. Test PASSed. This is

[GitHub] gatorsmile commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction

2018-12-19 Thread GitBox
gatorsmile commented on issue #23351: [SPARK-26216][SQL][followup] use abstract class instead of trait for UserDefinedFunction URL: https://github.com/apache/spark/pull/23351#issuecomment-448685731 Revert the changes in MIMA? See my comment : https://github.com/apache/spark/pull/23178/file

[GitHub] SparkQA commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-19 Thread GitBox
SparkQA commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-448685617 **[Test build #100307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100307/testReport)**

[GitHub] AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-19 Thread GitBox
AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-448685290 Merged build finished. Test PASSed. ---

[GitHub] AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-448685559 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] SparkQA commented on issue #21790: [SPARK-24544][SQL] Print actual failure cause when look up function failed

2018-12-19 Thread GitBox
SparkQA commented on issue #21790: [SPARK-24544][SQL] Print actual failure cause when look up function failed URL: https://github.com/apache/spark/pull/21790#issuecomment-448685659 **[Test build #100310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100310/

[GitHub] SparkQA commented on issue #21664: [SPARK-24687][CORE] NoClassDefFoundError will not be catch up which may cause job hanging

2018-12-19 Thread GitBox
SparkQA commented on issue #21664: [SPARK-24687][CORE] NoClassDefFoundError will not be catch up which may cause job hanging URL: https://github.com/apache/spark/pull/21664#issuecomment-448685691 **[Test build #100311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] SparkQA commented on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API

2018-12-19 Thread GitBox
SparkQA commented on issue #23349: [SPARK-26403][SQL] Support pivoting using array column for `pivot(column)` API URL: https://github.com/apache/spark/pull/23349#issuecomment-448685533 **[Test build #100301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100

[GitHub] AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-448685553 Merged build finished. Test PASSed. This is an autom

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline

2018-12-19 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline URL: https://github.com/apache/spark/pull/23263#issuecomment-448685667 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

  1   2   3   4   5   6   >