[GitHub] [spark] AmplabJenkins removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions

AmplabJenkins removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions URL: https://github.com/apache/spark/pull/24025#issuecomment-471255080 Test FAILed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] shivusondur commented on a change in pull request #24026: [SPARK-27090][CORE] Removing old LEGACY_DRIVER_IDENTIFIER ("")

shivusondur commented on a change in pull request #24026: [SPARK-27090][CORE] Removing old LEGACY_DRIVER_IDENTIFIER ("") URL: https://github.com/apache/spark/pull/24026#discussion_r264024208 ## File path: core/src/test/scala/org/apache/spark/ui/UIUtilsSuite.scala ##

[GitHub] [spark] AmplabJenkins removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions

AmplabJenkins removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions URL: https://github.com/apache/spark/pull/24025#issuecomment-471255077 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions

AmplabJenkins commented on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions URL: https://github.com/apache/spark/pull/24025#issuecomment-471255080 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions

SparkQA removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions URL: https://github.com/apache/spark/pull/24025#issuecomment-471236306 **[Test build #103272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] SparkQA commented on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions

SparkQA commented on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions URL: https://github.com/apache/spark/pull/24025#issuecomment-471255045 **[Test build #103272 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103272/te

[GitHub] [spark] AmplabJenkins commented on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions

AmplabJenkins commented on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions URL: https://github.com/apache/spark/pull/24025#issuecomment-471255077 Merged build finished. Test FAILed. This

[GitHub] [spark] WangGuangxin commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntegralColumn

WangGuangxin commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntegralColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-471254770 > How do you handle this behaviour change? > > ``` > // v2.4.0 > scala> Seq(0, Int.MaxValu

[GitHub] [spark] AmplabJenkins removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

AmplabJenkins removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471253191 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

AmplabJenkins removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471253192 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

SparkQA removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471251131 **[Test build #103276 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

AmplabJenkins commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471253192 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

AmplabJenkins commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471253191 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

SparkQA commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471253175 **[Test build #103276 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] rxin commented on issue #23882: [SPARK-26979][PYTHON] Add missing string column name support for some SQL functions

rxin commented on issue #23882: [SPARK-26979][PYTHON] Add missing string column name support for some SQL functions URL: https://github.com/apache/spark/pull/23882#issuecomment-471251512 What do we do for something like split, regexp_extract? ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5

AmplabJenkins removed a comment on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471251272 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5

AmplabJenkins removed a comment on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471251271 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5

AmplabJenkins commented on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471251272 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] AmplabJenkins commented on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5

AmplabJenkins commented on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471251271 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] SparkQA removed a comment on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5

SparkQA removed a comment on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471238517 **[Test build #103274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103274/testR

[GitHub] [spark] SparkQA commented on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5

SparkQA commented on issue #24042: [SPARK-27120][BUILD][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471251153 **[Test build #103274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103274/testReport)*

[GitHub] [spark] SparkQA commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

SparkQA commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471251131 **[Test build #103276 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103

[GitHub] [spark] AmplabJenkins commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

AmplabJenkins commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471251055 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

AmplabJenkins removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471251055 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

AmplabJenkins removed a comment on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471251053 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

AmplabJenkins commented on issue #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#issuecomment-471251053 Merged build finished. Test PASSed. ---

[GitHub] [spark] HyukjinKwon commented on a change in pull request #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

HyukjinKwon commented on a change in pull request #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#discussion_r264024876 ## File path: R/pkg/R/SQLContext.R ## @@ -197,17 +197,40 @@ writeT

[GitHub] [spark] HyukjinKwon commented on a change in pull request #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR

HyukjinKwon commented on a change in pull request #23969: [SPARK-26920][R] Deduplicate type checking across Arrow optimization in SparkR URL: https://github.com/apache/spark/pull/23969#discussion_r264024872 ## File path: R/pkg/R/SQLContext.R ## @@ -197,17 +197,40 @@ writeT

[GitHub] [spark] HyukjinKwon closed pull request #24023: [SPARK-27102][R][PYTHON][CORE] Remove the references to Python's Scala codes in R's Scala codes

HyukjinKwon closed pull request #24023: [SPARK-27102][R][PYTHON][CORE] Remove the references to Python's Scala codes in R's Scala codes URL: https://github.com/apache/spark/pull/24023 This is an automated message from the Ap

[GitHub] [spark] HyukjinKwon commented on issue #24023: [SPARK-27102][R][PYTHON][CORE] Remove the references to Python's Scala codes in R's Scala codes

HyukjinKwon commented on issue #24023: [SPARK-27102][R][PYTHON][CORE] Remove the references to Python's Scala codes in R's Scala codes URL: https://github.com/apache/spark/pull/24023#issuecomment-471250363 Merged to master. Thanks, guys. -

[GitHub] [spark] dbtsai commented on issue #24032: [SPARK-27097] [CHERRY-PICK 2.4] Avoid embedding platform-dependent offsets literally in whole-stage generated code

dbtsai commented on issue #24032: [SPARK-27097] [CHERRY-PICK 2.4] Avoid embedding platform-dependent offsets literally in whole-stage generated code URL: https://github.com/apache/spark/pull/24032#issuecomment-471250069 Merged into branch-2.4 Thanks! ---

[GitHub] [spark] hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md

hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md URL: https://github.com/apache/spark/pull/23999#discussion_r264024237 ## File path: docs/streaming-programming-guide.md #

[GitHub] [spark] hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md

hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md URL: https://github.com/apache/spark/pull/23999#discussion_r264024237 ## File path: docs/streaming-programming-guide.md #

[GitHub] [spark] hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md

hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md URL: https://github.com/apache/spark/pull/23999#discussion_r264024237 ## File path: docs/streaming-programming-guide.md #

[GitHub] [spark] hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md

hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md URL: https://github.com/apache/spark/pull/23999#discussion_r264024237 ## File path: docs/streaming-programming-guide.md #

[GitHub] [spark] hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md

hehuiyuan commented on a change in pull request #23999: [docs]Add additional explanation for "Setting the max receiving rate" in streaming-programming-guide.md URL: https://github.com/apache/spark/pull/23999#discussion_r264024237 ## File path: docs/streaming-programming-guide.md #

[GitHub] [spark] shivusondur commented on a change in pull request #24026: [SPARK-27090][CORE] Removing old LEGACY_DRIVER_IDENTIFIER ("")

shivusondur commented on a change in pull request #24026: [SPARK-27090][CORE] Removing old LEGACY_DRIVER_IDENTIFIER ("") URL: https://github.com/apache/spark/pull/24026#discussion_r264024208 ## File path: core/src/test/scala/org/apache/spark/ui/UIUtilsSuite.scala ##

[GitHub] [spark] fangshil commented on a change in pull request #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

fangshil commented on a change in pull request #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/20303#discussion_r264023809 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/EnsureR

[GitHub] [spark] fangshil commented on a change in pull request #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

fangshil commented on a change in pull request #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/20303#discussion_r264023809 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/EnsureR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471248111 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471248111 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471248112 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471248112 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] SparkQA removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

SparkQA removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471237131 **[Test build #103273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10327

[GitHub] [spark] SparkQA commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

SparkQA commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471248033 **[Test build #103273 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103273/testR

[GitHub] [spark] fangshil edited a comment on issue #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

fangshil edited a comment on issue #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/20303#issuecomment-469151637 Excited to see AE making progress in upstream:) We have used the new AE framework to add SQL optimizatio

[GitHub] [spark] fangshil commented on a change in pull request #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

fangshil commented on a change in pull request #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/20303#discussion_r264023809 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/EnsureR

[GitHub] [spark] fangshil commented on a change in pull request #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

fangshil commented on a change in pull request #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/20303#discussion_r264023809 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/EnsureR

[GitHub] [spark] SparkQA commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

SparkQA commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471246386 **[Test build #103275 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103275/testReport)*

[GitHub] [spark] AmplabJenkins removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

AmplabJenkins removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471246295 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

AmplabJenkins removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471246296 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

AmplabJenkins commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471246295 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

AmplabJenkins commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471246296 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] felixcheung commented on issue #23377: [SPARK-26439][CORE][WIP] Introduce WorkerOffer reservation mechanism for Barrier TaskSet

felixcheung commented on issue #23377: [SPARK-26439][CORE][WIP] Introduce WorkerOffer reservation mechanism for Barrier TaskSet URL: https://github.com/apache/spark/pull/23377#issuecomment-471246065 thanks @Ngone51 - I think you did bring up some very good point here in your description, a

[GitHub] [spark] AmplabJenkins removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

AmplabJenkins removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471245837 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

AmplabJenkins removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471245835 Merged build finished. Test FAILed. This i

[GitHub] [spark] AmplabJenkins commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

AmplabJenkins commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471245837 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

AmplabJenkins commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471245835 Merged build finished. Test FAILed. This is an aut

[GitHub] [spark] SparkQA removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

SparkQA removed a comment on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471234931 **[Test build #103271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103271/test

[GitHub] [spark] felixcheung commented on issue #24023: [SPARK-27102][R][PYTHON][CORE] Remove the references to Python's Scala codes in R's Scala codes

felixcheung commented on issue #24023: [SPARK-27102][R][PYTHON][CORE] Remove the references to Python's Scala codes in R's Scala codes URL: https://github.com/apache/spark/pull/24023#issuecomment-471245842 LGTM This is an aut

[GitHub] [spark] felixcheung commented on a change in pull request #24023: [SPARK-27102][R][PYTHON][CORE] Remove the references to Python's Scala codes in R's Scala codes

felixcheung commented on a change in pull request #24023: [SPARK-27102][R][PYTHON][CORE] Remove the references to Python's Scala codes in R's Scala codes URL: https://github.com/apache/spark/pull/24023#discussion_r264023028 ## File path: core/src/main/scala/org/apache/spark/api/r/R

[GitHub] [spark] SparkQA commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer

SparkQA commented on issue #23986: [SPARK-27070] Fix performance bug in DefaultPartitionCoalescer URL: https://github.com/apache/spark/pull/23986#issuecomment-471245791 **[Test build #103271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103271/testReport)

[GitHub] [spark] felixcheung commented on issue #18784: [SPARK-21559][Mesos] remove mesos fine-grained mode

felixcheung commented on issue #18784: [SPARK-21559][Mesos] remove mesos fine-grained mode URL: https://github.com/apache/spark/pull/18784#issuecomment-471245732 let's do it! it's only 2017 though. maybe we should wait until July 2019 its 2nd year anniversary to merge this? (ok, I'm jok

[GitHub] [spark] gatorsmile commented on issue #24032: [SPARK-27097] [CHERRY-PICK 2.4] Avoid embedding platform-dependent offsets literally in whole-stage generated code

gatorsmile commented on issue #24032: [SPARK-27097] [CHERRY-PICK 2.4] Avoid embedding platform-dependent offsets literally in whole-stage generated code URL: https://github.com/apache/spark/pull/24032#issuecomment-471239960 cc @dbtsai @rednaxelafx @cloud-fan @kiszk ---

[GitHub] [spark] ajithme commented on a change in pull request #23918: [SPARK-27011][SQL] reset command fails with cache

ajithme commented on a change in pull request #23918: [SPARK-27011][SQL] reset command fails with cache URL: https://github.com/apache/spark/pull/23918#discussion_r264020674 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/IgnoreCachedData.scala

[GitHub] [spark] AmplabJenkins commented on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5

AmplabJenkins commented on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471238775 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins removed a comment on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5

AmplabJenkins removed a comment on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471238775 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins removed a comment on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5

AmplabJenkins removed a comment on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471238773 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5

AmplabJenkins commented on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471238773 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] SparkQA commented on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5

SparkQA commented on issue #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042#issuecomment-471238517 **[Test build #103274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103274/testReport)** for P

[GitHub] [spark] wangyum opened a new pull request #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5

wangyum opened a new pull request #24042: [SPARK-27120][TEST] Upgrade scalatest version to 3.0.5 URL: https://github.com/apache/spark/pull/24042 ## What changes were proposed in this pull request? **ScalaTest 3.0.5 Release Notes** **Bug Fixes** - Fixed the implicit view

[GitHub] [spark] AmplabJenkins removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

AmplabJenkins removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471238394 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

AmplabJenkins removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471238395 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

AmplabJenkins commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471238395 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

AmplabJenkins commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471238394 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] SparkQA removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

SparkQA removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471221455 **[Test build #103270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103270/testRepo

[GitHub] [spark] SparkQA commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

SparkQA commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471238304 **[Test build #103270 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103270/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

AmplabJenkins removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471237869 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24018: [SPARK-23749][SQL] Workaround built-in Hive api changes (phase 1)

dongjoon-hyun edited a comment on issue #24018: [SPARK-23749][SQL] Workaround built-in Hive api changes (phase 1) URL: https://github.com/apache/spark/pull/24018#issuecomment-471237830 Thank you for requesting, @felixcheung . I'll take a look, too. -

[GitHub] [spark] AmplabJenkins commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

AmplabJenkins commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471237866 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] AmplabJenkins removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

AmplabJenkins removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471237866 Merged build finished. Test PASSed. This is an

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24018: [SPARK-23749][SQL] Workaround built-in Hive api changes (phase 1)

dongjoon-hyun edited a comment on issue #24018: [SPARK-23749][SQL] Workaround built-in Hive api changes (phase 1) URL: https://github.com/apache/spark/pull/24018#issuecomment-471237830 Thank you for requesting, @felixcheung . I'll take a look. --

[GitHub] [spark] AmplabJenkins commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

AmplabJenkins commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471237869 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] dongjoon-hyun commented on issue #24018: [SPARK-23749][SQL] Workaround built-in Hive api changes (phase 1)

dongjoon-hyun commented on issue #24018: [SPARK-23749][SQL] Workaround built-in Hive api changes (phase 1) URL: https://github.com/apache/spark/pull/24018#issuecomment-471237830 Thank you for requesting me, @felixcheung . I'll take a look, too. -

[GitHub] [spark] SparkQA removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

SparkQA removed a comment on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471220904 **[Test build #103269 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103269/testRepo

[GitHub] [spark] SparkQA commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management

SparkQA commented on issue #23599: [SPARK-24793][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599#issuecomment-471237766 **[Test build #103269 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103269/testReport)**

[GitHub] [spark] dongjoon-hyun commented on issue #23508: [SPARK-21351][SQL] Remove the UpdateAttributeNullability rule from the optimizer

dongjoon-hyun commented on issue #23508: [SPARK-21351][SQL] Remove the UpdateAttributeNullability rule from the optimizer URL: https://github.com/apache/spark/pull/23508#issuecomment-471237605 Hi, @maropu . Based on the our discussion history and the recent nullability fixes, we decide

[GitHub] [spark] wangyum commented on issue #24040: [SPARK-27118][SQL] Upgrade Hive Metastore Client to the latest versions for Hive 1.0.x/1.1.x

wangyum commented on issue #24040: [SPARK-27118][SQL] Upgrade Hive Metastore Client to the latest versions for Hive 1.0.x/1.1.x URL: https://github.com/apache/spark/pull/24040#issuecomment-471237317 Got it. Thank you @srowen @dongjoon-hyun -

[GitHub] [spark] SparkQA commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

SparkQA commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471237131 **[Test build #103273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103273/testRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471237024 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471237024 Merged build finished. Test PASSed. This is

[GitHub] [spark] srowen commented on a change in pull request #24028: [SPARK-26917][SQL] Further reduce locks in CacheManager

srowen commented on a change in pull request #24028: [SPARK-26917][SQL] Further reduce locks in CacheManager URL: https://github.com/apache/spark/pull/24028#discussion_r264020050 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471237026 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471237026 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] srowen commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

srowen commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471236940 I think we would generally not copy non-standard language features from other DBs. I am not sure this is worth it. C

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

dongjoon-hyun commented on a change in pull request #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#discussion_r264020007 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Fu

[GitHub] [spark] dongjoon-hyun commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

dongjoon-hyun commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-471236826 ok to test This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-470500924 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions

AmplabJenkins removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions URL: https://github.com/apache/spark/pull/24025#issuecomment-471236644 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions

AmplabJenkins removed a comment on issue #24025: [SPARK-27106][SQL] merge CaseInsensitiveStringMap and DataSourceOptions URL: https://github.com/apache/spark/pull/24025#issuecomment-471236645 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

  1   2   3   4   5   >