[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496966081 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins removed a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-496967697 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-496967697 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

AmplabJenkins commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-496967684 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24733: [SPARK-27869] Redact sensitive information in System Properties from UI

SparkQA removed a comment on issue #24733: [SPARK-27869] Redact sensitive information in System Properties from UI URL: https://github.com/apache/spark/pull/24733#issuecomment-496909951 **[Test build #4787 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496966072 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

SparkQA removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496961371 **[Test build #105914 has

[GitHub] [spark] SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496966035 **[Test build #105914 has

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496966081 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496966072 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #24733: [SPARK-27869] Redact sensitive information in System Properties from UI

SparkQA commented on issue #24733: [SPARK-27869] Redact sensitive information in System Properties from UI URL: https://github.com/apache/spark/pull/24733#issuecomment-496965607 **[Test build #4787 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

AmplabJenkins removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496964806 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

SparkQA removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496927731 **[Test build #105909 has

[GitHub] [spark] SparkQA commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

SparkQA commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-496964895 **[Test build #105915 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

AmplabJenkins removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496964775 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

AmplabJenkins commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496964806 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

AmplabJenkins commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496964775 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496964024 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

SparkQA commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496964521 **[Test build #105909 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496964011 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496964024 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496964011 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496961371 **[Test build #105914 has

[GitHub] [spark] cxzl25 commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

cxzl25 commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-496961357 @dongjoon-hyun Can you help me review on this PR?

[GitHub] [spark] SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-496961328 **[Test build #105913 has

[GitHub] [spark] srowen commented on a change in pull request #24717: [SPARK-27847][ML] One-Pass MultilabelMetrics & MulticlassMetrics

srowen commented on a change in pull request #24717: [SPARK-27847][ML] One-Pass MultilabelMetrics & MulticlassMetrics URL: https://github.com/apache/spark/pull/24717#discussion_r288596255 ## File path: mllib/src/main/scala/org/apache/spark/mllib/evaluation/MultilabelMetrics.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-496957037 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-496957044 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-496957037 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-496957044 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #24736: [SPARK-27862][Build] Move to json4s 3.6.5

SparkQA removed a comment on issue #24736: [SPARK-27862][Build] Move to json4s 3.6.5 URL: https://github.com/apache/spark/pull/24736#issuecomment-496908884 **[Test build #4786 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4786/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496952108 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] vanzin commented on a change in pull request #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

vanzin commented on a change in pull request #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#discussion_r288590770 ## File path:

[GitHub] [spark] SparkQA commented on issue #24736: [SPARK-27862][Build] Move to json4s 3.6.5

SparkQA commented on issue #24736: [SPARK-27862][Build] Move to json4s 3.6.5 URL: https://github.com/apache/spark/pull/24736#issuecomment-496955976 **[Test build #4786 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4786/testReport)** for PR 24736 at

[GitHub] [spark] LantaoJin commented on issue #24659: [SPARK-27788][SQL] Session aware event log for Spark thrift server

LantaoJin commented on issue #24659: [SPARK-27788][SQL] Session aware event log for Spark thrift server URL: https://github.com/apache/spark/pull/24659#issuecomment-496954419 @gatorsmile @cloud-fan @jiangxb1987 @HyukjinKwon @dongjoon-hyun any comments please.

[GitHub] [spark] SparkQA commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

SparkQA commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-496954396 **[Test build #105912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105912/testReport)**

[GitHub] [spark] tgravescs commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

tgravescs commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r288588353 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496952081 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

SparkQA removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496946687 **[Test build #105910 has

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496952108 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496952081 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496952030 **[Test build #105910 has

[GitHub] [spark] srowen commented on a change in pull request #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

srowen commented on a change in pull request #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#discussion_r288585267 ## File path: docs/configuration.md ## @@

[GitHub] [spark] srowen commented on a change in pull request #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

srowen commented on a change in pull request #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#discussion_r288584896 ## File path: docs/configuration.md ## @@

[GitHub] [spark] SparkQA removed a comment on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

SparkQA removed a comment on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#issuecomment-496890418 **[Test build #105907 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

AmplabJenkins removed a comment on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#issuecomment-496951120 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

AmplabJenkins removed a comment on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#issuecomment-496951151 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

AmplabJenkins commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#issuecomment-496951151 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

AmplabJenkins commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#issuecomment-496951120 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

SparkQA commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#issuecomment-496950263 **[Test build #105907 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-496948545 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-496948750 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-496948555 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-496948774 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-496948774 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-496948750 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-496948555 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-496948545 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

SparkQA removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-496888178 **[Test build #105905 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105905/testReport)** for

[GitHub] [spark] SparkQA removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

SparkQA removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-496885923 **[Test build #105904 has

[GitHub] [spark] SparkQA commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

SparkQA commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-496947902 **[Test build #105905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105905/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

SparkQA commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-496947743 **[Test build #105904 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-496945813 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496945752 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496945733 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-496945799 Merged build finished. Test PASSed. This is an

[GitHub] [spark] srowen commented on issue #24727: [SPARK-27867][ML] RegressionEvaluator cache lastest RegressionMetrics to avoid duplicated computation

srowen commented on issue #24727: [SPARK-27867][ML] RegressionEvaluator cache lastest RegressionMetrics to avoid duplicated computation URL: https://github.com/apache/spark/pull/24727#issuecomment-496946434 Yeah, that's pretty much the design of all of these evaluators, for better or

[GitHub] [spark] SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-496946725 **[Test build #105911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105911/testReport)**

[GitHub] [spark] SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496946687 **[Test build #105910 has

[GitHub] [spark] attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#discussion_r288515113 ## File path: core/src/main/scala/org/apache/spark/executor/ExecutorMetricsPoller.scala

[GitHub] [spark] attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#discussion_r288491219 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@

[GitHub] [spark] attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#discussion_r288513645 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@

[GitHub] [spark] attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#discussion_r288561893 ## File path: core/src/main/scala/org/apache/spark/executor/ExecutorMetricsPoller.scala

[GitHub] [spark] attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#discussion_r288500579 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@

[GitHub] [spark] attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#discussion_r288537094 ## File path: core/src/main/scala/org/apache/spark/executor/ExecutorMetricsPoller.scala

[GitHub] [spark] attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics.

attilapiros commented on a change in pull request #23767: [SPARK-26329][CORE] Faster polling of executor memory metrics. URL: https://github.com/apache/spark/pull/23767#discussion_r288527031 ## File path: core/src/main/scala/org/apache/spark/executor/ExecutorMetricsPoller.scala

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496945733 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-496945799 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-496945813 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-496945752 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] tgravescs commented on a change in pull request #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses

tgravescs commented on a change in pull request #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses URL: https://github.com/apache/spark/pull/24730#discussion_r288575964 ## File path: core/src/main/scala/org/apache/spark/ResourceDiscoverer.scala

[GitHub] [spark] srowen commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

srowen commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-496937456 Should be, if you log in. Hm, I wonder if you have to be whitelisted there too. @JoshRosen ?

[GitHub] [spark] tgravescs commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

tgravescs commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r288560539 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

AmplabJenkins removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-496931748 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

SparkQA removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-496890426 **[Test build #105906 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

AmplabJenkins removed a comment on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-496931739 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

AmplabJenkins commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-496931748 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

AmplabJenkins commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-496931739 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

SparkQA commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-496931434 **[Test build #105906 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105906/testReport)**

[GitHub] [spark] SparkQA commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

SparkQA commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496927731 **[Test build #105909 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

AmplabJenkins removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496926947 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

AmplabJenkins removed a comment on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496926938 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

AmplabJenkins commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496926947 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table

AmplabJenkins commented on issue #24721: [SPARK-27856][SQL] do not forcibly add cast when inserting table URL: https://github.com/apache/spark/pull/24721#issuecomment-496926938 Merged build finished. Test PASSed. This is an

[GitHub] [spark] gaborgsomogyi commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

gaborgsomogyi commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-496925800 @srowen do you mean there is a button on the mentioned page where jenkins can be started? I personally don't have such

[GitHub] [spark] SparkQA commented on issue #24710: [MINOR] [DOC] Fix spelling mistake

SparkQA commented on issue #24710: [MINOR] [DOC] Fix spelling mistake URL: https://github.com/apache/spark/pull/24710#issuecomment-496925161 **[Test build #4790 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4790/testReport)** for PR 24710 at commit

[GitHub] [spark] SparkQA commented on issue #24733: [SPARK-27869] Redact sensitive information in System Properties from UI

SparkQA commented on issue #24733: [SPARK-27869] Redact sensitive information in System Properties from UI URL: https://github.com/apache/spark/pull/24733#issuecomment-496923821 **[Test build #4789 has

[GitHub] [spark] srowen commented on a change in pull request #24736: [SPARK-27862][Build] Move to json4s 3.6.5

srowen commented on a change in pull request #24736: [SPARK-27862][Build] Move to json4s 3.6.5 URL: https://github.com/apache/spark/pull/24736#discussion_r288548800 ## File path: pom.xml ## @@ -762,14 +762,19 @@ org.json4s

[GitHub] [spark] cloud-fan commented on a change in pull request #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

cloud-fan commented on a change in pull request #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#discussion_r288548031 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

cloud-fan commented on a change in pull request #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#discussion_r288546979 ## File path:

<    2   3   4   5   6   7   8   9   10   >