[GitHub] [spark] AmplabJenkins removed a comment on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader URL: https://github.com/apache/spark/pull/28022#issuecomment-606436702 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins removed a comment on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader URL: https://github.com/apache/spark/pull/28022#issuecomment-606436710 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] AmplabJenkins commented on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader URL: https://github.com/apache/spark/pull/28022#issuecomment-606436702 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] AmplabJenkins commented on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader URL: https://github.com/apache/spark/pull/28022#issuecomment-606436710 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] SparkQA commented on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader

2020-03-30 Thread GitBox
SparkQA commented on issue #28022: [SPARK-31253][SQL] Add metrics to AQE shuffle reader URL: https://github.com/apache/spark/pull/28022#issuecomment-606436075 **[Test build #120630 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120630/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions`

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions` URL: https://github.com/apache/spark/pull/28056#issuecomment-606434886 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions`

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions` URL: https://github.com/apache/spark/pull/28056#issuecomment-606434878 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions`

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions` URL: https://github.com/apache/spark/pull/28056#issuecomment-606434886 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins commented on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions`

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions` URL: https://github.com/apache/spark/pull/28056#issuecomment-606434878 Merged build finished. Test FAILed. This is an autom

[GitHub] [spark] SparkQA removed a comment on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions`

2020-03-30 Thread GitBox
SparkQA removed a comment on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions` URL: https://github.com/apache/spark/pull/28056#issuecomment-606369583 **[Test build #120625 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120625/testRe

[GitHub] [spark] SparkQA commented on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions`

2020-03-30 Thread GitBox
SparkQA commented on issue #28056: [SPARK-31288][SQL] Remove `getRawTable` in `alterPartitions` URL: https://github.com/apache/spark/pull/28056#issuecomment-606434541 **[Test build #120625 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120625/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2)

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2) URL: https://github.com/apache/spark/pull/27992#issuecomment-606428282 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2)

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2) URL: https://github.com/apache/spark/pull/27992#issuecomment-606428276 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2)

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2) URL: https://github.com/apache/spark/pull/27992#issuecomment-606428282 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins commented on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2)

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2) URL: https://github.com/apache/spark/pull/27992#issuecomment-606428276 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] SparkQA commented on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2)

2020-03-30 Thread GitBox
SparkQA commented on issue #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2) URL: https://github.com/apache/spark/pull/27992#issuecomment-606427905 **[Test build #120629 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120629/testReport)**

[GitHub] [spark] cloud-fan commented on a change in pull request #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2)

2020-03-30 Thread GitBox
cloud-fan commented on a change in pull request #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2) URL: https://github.com/apache/spark/pull/27992#discussion_r400670269 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ## @

[GitHub] [spark] beliefer commented on issue #28064: [SPARK-31295][DOC] Supplement version for configuration appear in doc

2020-03-30 Thread GitBox
beliefer commented on issue #28064: [SPARK-31295][DOC] Supplement version for configuration appear in doc URL: https://github.com/apache/spark/pull/28064#issuecomment-606426543 @HyukjinKwon Thanks for all your help. This is a

[GitHub] [spark] HyukjinKwon commented on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound

2020-03-30 Thread GitBox
HyukjinKwon commented on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound URL: https://github.com/apache/spark/pull/28071#issuecomment-606423589 Merged to master, branch-3.0 and branch-2.4.

[GitHub] [spark] HyukjinKwon closed pull request #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound

2020-03-30 Thread GitBox
HyukjinKwon closed pull request #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound URL: https://github.com/apache/spark/pull/28071 This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2)

2020-03-30 Thread GitBox
cloud-fan commented on a change in pull request #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2) URL: https://github.com/apache/spark/pull/27992#discussion_r400665971 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/PlanResolutionSui

[GitHub] [spark] cloud-fan commented on a change in pull request #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2)

2020-03-30 Thread GitBox
cloud-fan commented on a change in pull request #27992: [SPARK-31230][SQL] Use statement plans in DataFrameWriter(V2) URL: https://github.com/apache/spark/pull/27992#discussion_r400665971 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/PlanResolutionSui

[GitHub] [spark] Ngone51 commented on a change in pull request #28070: [SPARK-31010][SQL] Add Java UDF suggestion in error message of untyped Scala UDF

2020-03-30 Thread GitBox
Ngone51 commented on a change in pull request #28070: [SPARK-31010][SQL] Add Java UDF suggestion in error message of untyped Scala UDF URL: https://github.com/apache/spark/pull/28070#discussion_r400665878 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ##

[GitHub] [spark] cloud-fan commented on a change in pull request #28048: [SPARK-31142][PYSPARK]Remove useless conf set in pyspark context

2020-03-30 Thread GitBox
cloud-fan commented on a change in pull request #28048: [SPARK-31142][PYSPARK]Remove useless conf set in pyspark context URL: https://github.com/apache/spark/pull/28048#discussion_r400663732 ## File path: python/pyspark/context.py ## @@ -181,11 +181,6 @@ def _do_init(self,

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications

2020-03-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#discussion_r400661739 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSub

[GitHub] [spark] AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606417814 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606417809 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606417809 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606417814 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] SparkQA removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
SparkQA removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606398596 **[Test build #120627 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120627/testRe

[GitHub] [spark] SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606417460 **[Test build #120627 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120627/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound URL: https://github.com/apache/spark/pull/28071#issuecomment-606414615 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound URL: https://github.com/apache/spark/pull/28071#issuecomment-606414623 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound URL: https://github.com/apache/spark/pull/28071#issuecomment-606414615 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound URL: https://github.com/apache/spark/pull/28071#issuecomment-606414623 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound

2020-03-30 Thread GitBox
SparkQA removed a comment on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound URL: https://github.com/apache/spark/pull/28071#issuecomment-606338420 **[Test build #120619 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] SparkQA commented on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound

2020-03-30 Thread GitBox
SparkQA commented on issue #28071: [SPARK-31306][DOCS] update rand() function documentation to indicate exclusive upper bound URL: https://github.com/apache/spark/pull/28071#issuecomment-606414095 **[Test build #120619 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606412644 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606412650 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606412650 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606412644 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] SparkQA removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
SparkQA removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606394469 **[Test build #120626 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120626/testRe

[GitHub] [spark] SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606412365 **[Test build #120626 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120626/testReport)**

[GitHub] [spark] stczwd commented on issue #28048: [SPARK-31142][PYSPARK]Remove useless conf set in pyspark context

2020-03-30 Thread GitBox
stczwd commented on issue #28048: [SPARK-31142][PYSPARK]Remove useless conf set in pyspark context URL: https://github.com/apache/spark/pull/28048#issuecomment-606412176 > Sure, you can reopen this when you have a valid use case and a unit test case, @stczwd . Thanks, @dongjoon-hyun

[GitHub] [spark] viirya commented on a change in pull request #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications

2020-03-30 Thread GitBox
viirya commented on a change in pull request #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#discussion_r400650242 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scal

[GitHub] [spark] AmplabJenkins commented on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606399021 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606399021 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606399024 Test PASSed. Refer to this link for build results (access rights to CI server need

[GitHub] [spark] AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606398962 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606399024 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606398956 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606398956 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606398962 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606398596 **[Test build #120627 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120627/testReport)**

[GitHub] [spark] SparkQA commented on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications

2020-03-30 Thread GitBox
SparkQA commented on issue #28077: [SPARK-31308][PySpark] Merging pyFiles to files argument for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606398594 **[Test build #120628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] viirya commented on a change in pull request #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
viirya commented on a change in pull request #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#discussion_r400641643 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.sca

[GitHub] [spark] AmplabJenkins removed a comment on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config URL: https://github.com/apache/spark/pull/28049#issuecomment-606398014 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config URL: https://github.com/apache/spark/pull/28049#issuecomment-606398019 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config URL: https://github.com/apache/spark/pull/28049#issuecomment-606398014 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config URL: https://github.com/apache/spark/pull/28049#issuecomment-606398019 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] SparkQA commented on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config

2020-03-30 Thread GitBox
SparkQA commented on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config URL: https://github.com/apache/spark/pull/28049#issuecomment-606397470 **[Test build #120623 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120623/testReport)**

[GitHub] [spark] SparkQA removed a comment on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config

2020-03-30 Thread GitBox
SparkQA removed a comment on issue #28049: [SPARK-31285][CORE] uppercase schedule mode string at config URL: https://github.com/apache/spark/pull/28049#issuecomment-606352230 **[Test build #120623 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120623/testRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore URL: https://github.com/apache/spark/pull/26935#issuecomment-606396478 Test FAILed. Refer to this link for build results (access rights to CI s

[GitHub] [spark] SparkQA commented on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-03-30 Thread GitBox
SparkQA commented on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore URL: https://github.com/apache/spark/pull/26935#issuecomment-606396308 **[Test build #120621 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] [spark] AmplabJenkins commented on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore URL: https://github.com/apache/spark/pull/26935#issuecomment-606396473 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore URL: https://github.com/apache/spark/pull/26935#issuecomment-606396478 Test FAILed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] AmplabJenkins removed a comment on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore URL: https://github.com/apache/spark/pull/26935#issuecomment-606396473 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA removed a comment on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-03-30 Thread GitBox
SparkQA removed a comment on issue #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore URL: https://github.com/apache/spark/pull/26935#issuecomment-606343418 **[Test build #120621 has started](https://amplab.cs.berkeley.edu/jenkins/job/Sp

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function

2020-03-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function URL: https://github.com/apache/spark/pull/27836#discussion_r400638874 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions

[GitHub] [spark] AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606392826 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
SparkQA commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606394469 **[Test build #120626 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120626/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606392821 Merged build finished. Test PASSed. This is

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function

2020-03-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function URL: https://github.com/apache/spark/pull/27836#discussion_r400637284 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions

[GitHub] [spark] AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606392821 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078#issuecomment-606392826 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] zhengruifeng opened a new pull request #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML

2020-03-30 Thread GitBox
zhengruifeng opened a new pull request #28078: [SPARK-31309][ML] Migrate the ChiSquareTest from MLlib to ML URL: https://github.com/apache/spark/pull/28078 ### What changes were proposed in this pull request? 1, Move the impl of ChiSq from .mllib to the .ml side; 2, in `.mllib.ChiSqTe

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function

2020-03-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function URL: https://github.com/apache/spark/pull/27836#discussion_r400636724 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/JsonExpressions

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function

2020-03-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function URL: https://github.com/apache/spark/pull/27836#discussion_r400636651 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/JsonExpressions

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function

2020-03-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #27836: [SPARK-31009][SQL] Support json_object_keys function URL: https://github.com/apache/spark/pull/27836#discussion_r400636486 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions

[GitHub] [spark] wangyum commented on issue #27986: [SPARK-31220][SQL] repartition obeys initialPartitionNum when adaptiveExecutionEnabled

2020-03-30 Thread GitBox
wangyum commented on issue #27986: [SPARK-31220][SQL] repartition obeys initialPartitionNum when adaptiveExecutionEnabled URL: https://github.com/apache/spark/pull/27986#issuecomment-606391972 cc @cloud-fan @HyukjinKwon @dongjoon-hyun @maryannxue Do we need this change to make `DISTRIBUTE

[GitHub] [spark] wangyum removed a comment on issue #27986: [SPARK-31220][SQL] repartition obeys initialPartitionNum when adaptiveExecutionEnabled

2020-03-30 Thread GitBox
wangyum removed a comment on issue #27986: [SPARK-31220][SQL] repartition obeys initialPartitionNum when adaptiveExecutionEnabled URL: https://github.com/apache/spark/pull/27986#issuecomment-602942046 cc @cloud-fan This is a

[GitHub] [spark] AmplabJenkins removed a comment on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606391003 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606391005 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins commented on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606391005 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606391003 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
SparkQA removed a comment on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606349919 **[Test build #120622 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] SparkQA commented on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
SparkQA commented on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606390509 **[Test build #120622 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] dongjoon-hyun commented on issue #28076: [WIP][SQL] Benchmark dates/timestamps rebasing in ORC datasource

2020-03-30 Thread GitBox
dongjoon-hyun commented on issue #28076: [WIP][SQL] Benchmark dates/timestamps rebasing in ORC datasource URL: https://github.com/apache/spark/pull/28076#issuecomment-606390246 Could you file a JIRA before making a PR? You can make a `DRAFT` PR feature of GitHub for `WIP`. ---

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#discussion_r400634191 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSu

[GitHub] [spark] dongjoon-hyun commented on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications

2020-03-30 Thread GitBox
dongjoon-hyun commented on issue #28077: [SPARK-31308][PySpark] Make Python dependencies available for Non-PySpark applications URL: https://github.com/apache/spark/pull/28077#issuecomment-606388764 Hi, @viirya . This PR title looks too broad. Could you be more specific by excluding the sc

[GitHub] [spark] wangyum closed pull request #28068: [MINOR][CORE] Remove two unused variables in LiveListenerBus

2020-03-30 Thread GitBox
wangyum closed pull request #28068: [MINOR][CORE] Remove two unused variables in LiveListenerBus URL: https://github.com/apache/spark/pull/28068 This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [spark] AmplabJenkins removed a comment on issue #27066: [SPARK-22231][SQL] Add withField method to Column class

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #27066: [SPARK-22231][SQL] Add withField method to Column class URL: https://github.com/apache/spark/pull/27066#issuecomment-606386421 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #27066: [SPARK-22231][SQL] Add withField method to Column class

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #27066: [SPARK-22231][SQL] Add withField method to Column class URL: https://github.com/apache/spark/pull/27066#issuecomment-606386416 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27066: [SPARK-22231][SQL] Add withField method to Column class

2020-03-30 Thread GitBox
AmplabJenkins removed a comment on issue #27066: [SPARK-22231][SQL] Add withField method to Column class URL: https://github.com/apache/spark/pull/27066#issuecomment-606386416 Merged build finished. Test FAILed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #27066: [SPARK-22231][SQL] Add withField method to Column class

2020-03-30 Thread GitBox
AmplabJenkins commented on issue #27066: [SPARK-22231][SQL] Add withField method to Column class URL: https://github.com/apache/spark/pull/27066#issuecomment-606386421 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] SparkQA removed a comment on issue #27066: [SPARK-22231][SQL] Add withField method to Column class

2020-03-30 Thread GitBox
SparkQA removed a comment on issue #27066: [SPARK-22231][SQL] Add withField method to Column class URL: https://github.com/apache/spark/pull/27066#issuecomment-606317173 **[Test build #120617 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120617/testReport)

[GitHub] [spark] SparkQA commented on issue #27066: [SPARK-22231][SQL] Add withField method to Column class

2020-03-30 Thread GitBox
SparkQA commented on issue #27066: [SPARK-22231][SQL] Add withField method to Column class URL: https://github.com/apache/spark/pull/27066#issuecomment-606386084 **[Test build #120617 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120617/testReport)** for

[GitHub] [spark] dongjoon-hyun commented on issue #28048: [SPARK-31142][PYSPARK]Remove useless conf set in pyspark context

2020-03-30 Thread GitBox
dongjoon-hyun commented on issue #28048: [SPARK-31142][PYSPARK]Remove useless conf set in pyspark context URL: https://github.com/apache/spark/pull/28048#issuecomment-606385501 Sure, you can reopen this when you have a valid use case and a unit test case, @stczwd . ---

[GitHub] [spark] HyukjinKwon closed pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive

2020-03-30 Thread GitBox
HyukjinKwon closed pull request #28042: [SPARK-31279][SQL][DOC] Add version information to the configuration of Hive URL: https://github.com/apache/spark/pull/28042 This is an automated message from the Apache Git Service. T

[GitHub] [spark] HyukjinKwon closed pull request #28064: [SPARK-31295][DOC] Supplement version for configuration appear in doc

2020-03-30 Thread GitBox
HyukjinKwon closed pull request #28064: [SPARK-31295][DOC] Supplement version for configuration appear in doc URL: https://github.com/apache/spark/pull/28064 This is an automated message from the Apache Git Service. To respo

  1   2   3   4   5   6   7   8   9   >