[GitHub] [spark] Ngone51 commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles

Ngone51 commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles URL: https://github.com/apache/spark/pull/27031#discussion_r361919592 ## File path:

[GitHub] [spark] SparkQA commented on issue #26847: [SPARK-30214][SQL] A new framework to resolve v2 commands

SparkQA commented on issue #26847: [SPARK-30214][SQL] A new framework to resolve v2 commands URL: https://github.com/apache/spark/pull/26847#issuecomment-569609024 **[Test build #115938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115938/testReport)**

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361917338 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

HyukjinKwon commented on a change in pull request #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source URL: https://github.com/apache/spark/pull/27039#discussion_r361918722 ## File path:

[GitHub] [spark] ajithme edited a comment on issue #24076: [SPARK-27142][SQL] Provide REST API for SQL level information

ajithme edited a comment on issue #24076: [SPARK-27142][SQL] Provide REST API for SQL level information URL: https://github.com/apache/spark/pull/24076#issuecomment-569068726 Gentle ping @vanzin @gengliangwang @dongjoon-hyun @HyukjinKwon @srowen

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles

HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles URL: https://github.com/apache/spark/pull/27031#discussion_r361917663 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API

AmplabJenkins commented on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API URL: https://github.com/apache/spark/pull/26809#issuecomment-569606991 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API

AmplabJenkins removed a comment on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API URL: https://github.com/apache/spark/pull/26809#issuecomment-569606991 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361917338 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API

AmplabJenkins removed a comment on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API URL: https://github.com/apache/spark/pull/26809#issuecomment-569606986 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API

AmplabJenkins commented on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API URL: https://github.com/apache/spark/pull/26809#issuecomment-569606986 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361917338 ## File path:

[GitHub] [spark] ajithme commented on a change in pull request #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

ajithme commented on a change in pull request #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source URL: https://github.com/apache/spark/pull/27039#discussion_r361917537 ## File path:

[GitHub] [spark] ajithme commented on a change in pull request #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

ajithme commented on a change in pull request #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source URL: https://github.com/apache/spark/pull/27039#discussion_r361917537 ## File path:

[GitHub] [spark] SparkQA commented on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API

SparkQA commented on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API URL: https://github.com/apache/spark/pull/26809#issuecomment-569606708 **[Test build #115930 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115930/testReport)** for PR 26809

[GitHub] [spark] SparkQA removed a comment on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API

SparkQA removed a comment on issue #26809: [SPARK-30185][SQL] Implement Dataset.tail API URL: https://github.com/apache/spark/pull/26809#issuecomment-569575573 **[Test build #115930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115930/testReport)** for

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361917338 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361917338 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles

HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles URL: https://github.com/apache/spark/pull/27031#discussion_r361915141 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles

HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles URL: https://github.com/apache/spark/pull/27031#discussion_r361915141 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles

HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles URL: https://github.com/apache/spark/pull/27031#discussion_r361915141 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles

HyukjinKwon commented on a change in pull request #27031: [SPARK-30373][SQL] Avoid unnecessary sort for ParquetUtils.splitFiles URL: https://github.com/apache/spark/pull/27031#discussion_r361915141 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

cloud-fan commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361914679 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26847: [SPARK-30214][SQL] A new framework to resolve v2 commands

cloud-fan commented on a change in pull request #26847: [SPARK-30214][SQL] A new framework to resolve v2 commands URL: https://github.com/apache/spark/pull/26847#discussion_r361914149 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala

[GitHub] [spark] cloud-fan commented on a change in pull request #26847: [SPARK-30214][SQL] A new framework to resolve v2 commands

cloud-fan commented on a change in pull request #26847: [SPARK-30214][SQL] A new framework to resolve v2 commands URL: https://github.com/apache/spark/pull/26847#discussion_r361912665 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

[GitHub] [spark] cloud-fan closed pull request #27027: [SPARK-30370][SQL] Update SqlBase.g4 to combine namespace and database tokens.

cloud-fan closed pull request #27027: [SPARK-30370][SQL] Update SqlBase.g4 to combine namespace and database tokens. URL: https://github.com/apache/spark/pull/27027 This is an automated message from the Apache Git Service.

[GitHub] [spark] cloud-fan commented on issue #27027: [SPARK-30370][SQL] Update SqlBase.g4 to combine namespace and database tokens.

cloud-fan commented on issue #27027: [SPARK-30370][SQL] Update SqlBase.g4 to combine namespace and database tokens. URL: https://github.com/apache/spark/pull/27027#issuecomment-569599168 thanks, merging to master! This is an

[GitHub] [spark] HeartSaVioR commented on issue #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..."

HeartSaVioR commented on issue #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..." URL: https://github.com/apache/spark/pull/27004#issuecomment-569599034 Thanks for reviewing and merging!

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

HyukjinKwon commented on a change in pull request #27039: [SPARK-29174][SQL] LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source URL: https://github.com/apache/spark/pull/27039#discussion_r361910584 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

AmplabJenkins removed a comment on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#issuecomment-569596879 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

AmplabJenkins removed a comment on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#issuecomment-569596878 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

AmplabJenkins commented on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#issuecomment-569596879 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

AmplabJenkins commented on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#issuecomment-569596878 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

SparkQA commented on issue #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#issuecomment-569596654 **[Test build #115937 has

[GitHub] [spark] cloud-fan closed pull request #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..."

cloud-fan closed pull request #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..." URL: https://github.com/apache/spark/pull/27004 This is an automated message from

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27045: [SPARK-27506][SQL][FOLLOWUP] Use option `avroSchema` to specify an evolved schema in `from_avro`

HyukjinKwon commented on a change in pull request #27045: [SPARK-27506][SQL][FOLLOWUP] Use option `avroSchema` to specify an evolved schema in `from_avro` URL: https://github.com/apache/spark/pull/27045#discussion_r361908373 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27045: [SPARK-27506][SQL][FOLLOWUP] Use option `avroSchema` to specify an evolved schema in `from_avro`

HyukjinKwon commented on a change in pull request #27045: [SPARK-27506][SQL][FOLLOWUP] Use option `avroSchema` to specify an evolved schema in `from_avro` URL: https://github.com/apache/spark/pull/27045#discussion_r361908355 ## File path:

[GitHub] [spark] cloud-fan commented on issue #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..."

cloud-fan commented on issue #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..." URL: https://github.com/apache/spark/pull/27004#issuecomment-569596298 thanks, merging to master!

[GitHub] [spark] viirya commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

viirya commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#discussion_r361907705 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361907231 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

AmplabJenkins removed a comment on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569594628 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

AmplabJenkins removed a comment on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569594633 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

AmplabJenkins commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569594633 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

AmplabJenkins commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569594628 Merged build finished. Test PASSed.

[GitHub] [spark] ajithme commented on issue #27042: [SPARK-30382] start-thriftserver --help throws ClassNotFoundException

ajithme commented on issue #27042: [SPARK-30382] start-thriftserver --help throws ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-569594377 Thanks for the details @HeartSaVioR So what is the suggestion here, should we 1. include `log4j2` to complete

[GitHub] [spark] SparkQA commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

SparkQA commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569594457 **[Test build #115936 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

HyukjinKwon commented on a change in pull request #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#discussion_r361906028 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#discussion_r361905946 ## File path: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala

[GitHub] [spark] cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#discussion_r361906015 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#discussion_r361905789 ## File path: mllib/src/test/scala/org/apache/spark/ml/recommendation/ALSSuite.scala

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

HeartSaVioR commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361905710 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27027: [SPARK-30370][SQL] Update SqlBase.g4 to combine namespace and database tokens.

cloud-fan commented on a change in pull request #27027: [SPARK-30370][SQL] Update SqlBase.g4 to combine namespace and database tokens. URL: https://github.com/apache/spark/pull/27027#discussion_r361905592 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

cloud-fan commented on a change in pull request #27025: [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader URL: https://github.com/apache/spark/pull/27025#discussion_r361905472 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

AmplabJenkins removed a comment on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569592381 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors

AmplabJenkins removed a comment on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors URL: https://github.com/apache/spark/pull/26982#issuecomment-569592449 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

AmplabJenkins removed a comment on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569592383 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors

AmplabJenkins removed a comment on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors URL: https://github.com/apache/spark/pull/26982#issuecomment-569592447 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors

AmplabJenkins commented on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors URL: https://github.com/apache/spark/pull/26982#issuecomment-569592447 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors

AmplabJenkins commented on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors URL: https://github.com/apache/spark/pull/26982#issuecomment-569592449 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

AmplabJenkins commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569592383 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

viirya commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#discussion_r361905102 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@

[GitHub] [spark] viirya commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

viirya commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#discussion_r361905159 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@

[GitHub] [spark] SparkQA removed a comment on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors

SparkQA removed a comment on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors URL: https://github.com/apache/spark/pull/26982#issuecomment-569573308 **[Test build #115929 has

[GitHub] [spark] AmplabJenkins commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

AmplabJenkins commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569592381 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

SparkQA commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569592195 **[Test build #115935 has

[GitHub] [spark] SparkQA commented on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors

SparkQA commented on issue #26982: [SPARK-30329][ML] add iterator/foreach methods for Vectors URL: https://github.com/apache/spark/pull/26982#issuecomment-569592231 **[Test build #115929 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115929/testReport)**

[GitHub] [spark] huaxingao commented on issue #26838: [SPARK-30144][ML][PySpark] Make MultilayerPerceptronClassificationModel extend MultilayerPerceptronParams

huaxingao commented on issue #26838: [SPARK-30144][ML][PySpark] Make MultilayerPerceptronClassificationModel extend MultilayerPerceptronParams URL: https://github.com/apache/spark/pull/26838#issuecomment-569592099 @zhengruifeng Yes. The models are now in mllib/src/test/resources/ml-models

[GitHub] [spark] HeartSaVioR commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

HeartSaVioR commented on issue #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#issuecomment-569592060 Thanks for reviewing, reflected review comments, as well as updated PR description to reflect the

[GitHub] [spark] zhengruifeng commented on issue #26483: [SPARK-29823][MLLIB] Improper persist strategy in mllib.clustering.KMeans.run()

zhengruifeng commented on issue #26483: [SPARK-29823][MLLIB] Improper persist strategy in mllib.clustering.KMeans.run() URL: https://github.com/apache/spark/pull/26483#issuecomment-569591409 @srowen I agree that there should be somewhat perfermance improvement if RAM is big enough, at the

[GitHub] [spark] cloud-fan commented on a change in pull request #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..."

cloud-fan commented on a change in pull request #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..." URL: https://github.com/apache/spark/pull/27004#discussion_r361904220 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..."

cloud-fan commented on a change in pull request #27004: [SPARK-30348][CORE][TEST] Fix flaky test failure on "MasterSuite.SPARK-27510: Master should avoid ..." URL: https://github.com/apache/spark/pull/27004#discussion_r361904220 ## File path:

[GitHub] [spark] SparkQA commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

SparkQA commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-569591103 **[Test build #115934 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

HyukjinKwon commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#discussion_r361904104 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

HyukjinKwon commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#discussion_r361904158 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@

[GitHub] [spark] AmplabJenkins commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent

AmplabJenkins commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/26975#issuecomment-569590664 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent

AmplabJenkins removed a comment on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/26975#issuecomment-569590666 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent

AmplabJenkins removed a comment on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/26975#issuecomment-569590664 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent

AmplabJenkins commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/26975#issuecomment-569590666 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator

HyukjinKwon commented on a change in pull request #27038: [SPARK-30379][Core] Avoid OOM when using collection accumulator URL: https://github.com/apache/spark/pull/27038#discussion_r361903913 ## File path: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ## @@

[GitHub] [spark] SparkQA removed a comment on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent

SparkQA removed a comment on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/26975#issuecomment-569571087 **[Test build #115928 has

[GitHub] [spark] SparkQA commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent

SparkQA commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/26975#issuecomment-569590405 **[Test build #115928 has

[GitHub] [spark] cloud-fan commented on issue #27045: [SPARK-27506][SQL][FOLLOWUP] Use option `avroSchema` to specify an evolved schema in `from_avro`

cloud-fan commented on issue #27045: [SPARK-27506][SQL][FOLLOWUP] Use option `avroSchema` to specify an evolved schema in `from_avro` URL: https://github.com/apache/spark/pull/27045#issuecomment-569590321 +1 to have less options

[GitHub] [spark] AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569590190 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-569590172 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569590182 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-569590164 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569590190 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-569590172 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569590182 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-569590164 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569589968 **[Test build #115933 has

[GitHub] [spark] cloud-fan commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent

cloud-fan commented on issue #26975: [SPARK-30325][CORE] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/26975#issuecomment-569590023 Note that, a task roughly has 2 states: running and finished. a partition has 2 states as well: successful

[GitHub] [spark] JkSelf commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

JkSelf commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569589293 retest this please This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569589124 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569589123 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569589124 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569589123 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

SparkQA removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569563764 **[Test build #115925 has

[GitHub] [spark] SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-569588966 **[Test build #115925 has

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics

HeartSaVioR commented on a change in pull request #27046: [SPARK-29348][SQL][FOLLOWUP] Add example of batch query for observable metrics URL: https://github.com/apache/spark/pull/27046#discussion_r361901113 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala

  1   2   3   4   5   >