[GitHub] [spark] AmplabJenkins commented on issue #24865: [SPARK-27100][SQL] dag-scheduler-event-loop" java.lang.StackOverflowError

AmplabJenkins commented on issue #24865: [SPARK-27100][SQL] dag-scheduler-event-loop" java.lang.StackOverflowError URL: https://github.com/apache/spark/pull/24865#issuecomment-502244482 Merged build finished. Test PASSed. Thi

[GitHub] [spark] AmplabJenkins commented on issue #24865: [SPARK-27100][SQL] dag-scheduler-event-loop" java.lang.StackOverflowError

AmplabJenkins commented on issue #24865: [SPARK-27100][SQL] dag-scheduler-event-loop" java.lang.StackOverflowError URL: https://github.com/apache/spark/pull/24865#issuecomment-502244487 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] SparkQA removed a comment on issue #24865: [SPARK-27100][SQL] dag-scheduler-event-loop" java.lang.StackOverflowError

SparkQA removed a comment on issue #24865: [SPARK-27100][SQL] dag-scheduler-event-loop" java.lang.StackOverflowError URL: https://github.com/apache/spark/pull/24865#issuecomment-502184789 **[Test build #106521 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] SparkQA commented on issue #24865: [SPARK-27100][SQL] dag-scheduler-event-loop" java.lang.StackOverflowError

SparkQA commented on issue #24865: [SPARK-27100][SQL] dag-scheduler-event-loop" java.lang.StackOverflowError URL: https://github.com/apache/spark/pull/24865#issuecomment-502243970 **[Test build #106521 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106521/

[GitHub] [spark] SparkQA commented on issue #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

SparkQA commented on issue #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#issuecomment-502241289 **[Test build #106530 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106530/testRepor

[GitHub] [spark] abellina edited a comment on issue #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

abellina edited a comment on issue #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#issuecomment-502239885 Thanks for addressing the review comments @revans2. I am +1 (non binding). I can't count myself as a ca

[GitHub] [spark] abellina commented on issue #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

abellina commented on issue #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#issuecomment-502239885 Thanks for addressing the review comments @revans2. I am +1 (non binding). I can't count myself as a catalyst

[GitHub] [spark] AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502237616 Test FAILed. Refer to this link for build results (a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502237608 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502237616 Test FAILed. Refer to this link for build results (access rig

[GitHub] [spark] AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502237608 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

SparkQA removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502201909 **[Test build #106528 has started](https://amplab.cs.berkeley

[GitHub] [spark] SparkQA commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

SparkQA commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502237343 **[Test build #106528 has finished](https://amplab.cs.berkeley.edu/je

[GitHub] [spark] abellina commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

abellina commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#discussion_r293939557 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SparkSessionExtensionSuite.scala

[GitHub] [spark] abellina commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

abellina commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#discussion_r293935318 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/vectorized/ColumnarBat

[GitHub] [spark] abellina commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing

abellina commented on a change in pull request #24795: [SPARK-27945][SQL] Minimal changes to support columnar processing URL: https://github.com/apache/spark/pull/24795#discussion_r293931685 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/vectorized/ColumnarBat

[GitHub] [spark] AmplabJenkins removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

AmplabJenkins removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502232564 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

AmplabJenkins removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502232556 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

SparkQA commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502232536 **[Test build #106527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] AmplabJenkins commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

AmplabJenkins commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502232556 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

SparkQA removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502201906 **[Test build #106527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

AmplabJenkins commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502232564 Test FAILed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins removed a comment on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode

AmplabJenkins removed a comment on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode URL: https://github.com/apache/spark/pull/24876#issuecomment-502227309 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] AmplabJenkins removed a comment on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode

AmplabJenkins removed a comment on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode URL: https://github.com/apache/spark/pull/24876#issuecomment-502227305 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode

SparkQA commented on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode URL: https://github.com/apache/spark/pull/24876#issuecomment-502227877 **[Test build #106529 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106529/testReport)** f

[GitHub] [spark] maryannxue commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

maryannxue commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502227213 @hvanhovell Just submitted https://github.com/apache/spark/pull/24876 for the TreeNode changes. Please take a

[GitHub] [spark] AmplabJenkins commented on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode

AmplabJenkins commented on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode URL: https://github.com/apache/spark/pull/24876#issuecomment-502227309 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins commented on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode

AmplabJenkins commented on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode URL: https://github.com/apache/spark/pull/24876#issuecomment-502227305 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] maryannxue commented on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode

maryannxue commented on issue #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode URL: https://github.com/apache/spark/pull/24876#issuecomment-502226708 @hvanhovell This is an automated message from the Apache

[GitHub] [spark] maryannxue opened a new pull request #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode

maryannxue opened a new pull request #24876: [SPARK-28057][SQL] Add method `clone` in catalyst TreeNode URL: https://github.com/apache/spark/pull/24876 ## What changes were proposed in this pull request? Implemented the `clone` method for `TreeNode` based on `mapChildren`. ##

[GitHub] [spark] mengxr commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502224053 I created https://issues.apache.org/jira/browse/SPARK-28056 for the fo

[GitHub] [spark] mengxr commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

mengxr commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502223340 I added two tests that verifies init and close with the new UDF. LGTM

[GitHub] [spark] WitJakuczun closed pull request #24797: Detecting key in map type when value type is complex

WitJakuczun closed pull request #24797: Detecting key in map type when value type is complex URL: https://github.com/apache/spark/pull/24797 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] WitJakuczun commented on a change in pull request #24797: Detecting key in map type when value type is complex

WitJakuczun commented on a change in pull request #24797: Detecting key in map type when value type is complex URL: https://github.com/apache/spark/pull/24797#discussion_r293933613 ## File path: R/pkg/R/schema.R ## @@ -162,7 +162,7 @@ checkType <- function(type) {

[GitHub] [spark] AmplabJenkins removed a comment on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql

AmplabJenkins removed a comment on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql URL: https://github.com/apache/spark/pull/24853#issuecomment-502220116 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] AmplabJenkins removed a comment on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql

AmplabJenkins removed a comment on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql URL: https://github.com/apache/spark/pull/24853#issuecomment-502220097 Merged build finished. Test FAILed. This is an automated message f

[GitHub] [spark] SparkQA removed a comment on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql

SparkQA removed a comment on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql URL: https://github.com/apache/spark/pull/24853#issuecomment-502174188 **[Test build #106520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106520/testReport)** for PR 24853

[GitHub] [spark] AmplabJenkins commented on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql

AmplabJenkins commented on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql URL: https://github.com/apache/spark/pull/24853#issuecomment-502220097 Merged build finished. Test FAILed. This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql

AmplabJenkins commented on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql URL: https://github.com/apache/spark/pull/24853#issuecomment-502220116 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/Spa

[GitHub] [spark] SparkQA commented on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql

SparkQA commented on issue #24853: [SPARK-28029][SQL][TEST] Port int2.sql URL: https://github.com/apache/spark/pull/24853#issuecomment-502219824 **[Test build #106520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106520/testReport)** for PR 24853 at commi

[GitHub] [spark] AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502216998 Test FAILed. Refer to this link for build results (access rights to C

[GitHub] [spark] SparkQA removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

SparkQA removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502190627 **[Test build #106525 has started](https://amplab.cs.berkeley.edu/jenkins/job

[GitHub] [spark] AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502216981 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502216998 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502216981 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

SparkQA commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502216781 **[Test build #106525 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] AmplabJenkins commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding.

AmplabJenkins commented on issue #22347: [SPARK-25353][SQL] executeTake in SparkPlan is modified to avoid unnecessary decoding. URL: https://github.com/apache/spark/pull/22347#issuecomment-502206062 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

AmplabJenkins removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502203791 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

AmplabJenkins removed a comment on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502203780 Merged build finished. Test PASSed. --

[GitHub] [spark] srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s

srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#discussion_r293913528 ## File path: core/src/main/scala/org/apache/spark/executor/CoarseGrain

[GitHub] [spark] srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s

srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#discussion_r293913955 ## File path: resource-managers/kubernetes/docker/src/main/dockerfiles/

[GitHub] [spark] srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s

srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#discussion_r293913767 ## File path: common/network-common/src/main/java/org/apache/spark/netw

[GitHub] [spark] AmplabJenkins commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

AmplabJenkins commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502203791 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

AmplabJenkins commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502203780 Merged build finished. Test PASSed. --

[GitHub] [spark] srowen closed pull request #24863: [SPARK-21882][CORE] OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

srowen closed pull request #24863: [SPARK-21882][CORE] OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function URL: https://github.com/apache/spark/pull/24863 This is an automated message from

[GitHub] [spark] srowen commented on issue #24863: [SPARK-21882][CORE] OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

srowen commented on issue #24863: [SPARK-21882][CORE] OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function URL: https://github.com/apache/spark/pull/24863#issuecomment-502203238 Merged to master/2.4/2.3

[GitHub] [spark] SparkQA commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context

SparkQA commented on issue #24807: [SPARK-27958][SQL] Stopping a SparkSession should not always stop Spark Context URL: https://github.com/apache/spark/pull/24807#issuecomment-502201906 **[Test build #106527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502201169 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502201177 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502201284 Test PASSed. Refer to this link for build results (a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502201251 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

SparkQA commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502201909 **[Test build #106528 has started](https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502201177 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502201169 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502201284 Test PASSed. Refer to this link for build results (access rig

[GitHub] [spark] AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502201251 Merged build finished. Test PASSed. ---

[GitHub] [spark] srowen commented on a change in pull request #24861: [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture BUG

srowen commented on a change in pull request #24861: [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture BUG URL: https://github.com/apache/spark/pull/24861#discussion_r293907574 ## File path: common/unsafe/src/main/java/org/apache/sp

[GitHub] [spark] maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#discussion_r293907198 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeN

[GitHub] [spark] SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502197912 **[Test build #106526 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106526/tes

[GitHub] [spark] shaneknapp commented on issue #24844: [SPARK-28003][PYTHON] Allow NaT values when creating Spark dataframe from pandas with Arrow

shaneknapp commented on issue #24844: [SPARK-28003][PYTHON] Allow NaT values when creating Spark dataframe from pandas with Arrow URL: https://github.com/apache/spark/pull/24844#issuecomment-502195606 as mentioned on dev@ and other github issues, we're testing against 0.24.2 and will con

[GitHub] [spark] ssimeonov commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

ssimeonov commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-502193579 It's extremely weird and inconsistent for there to be SparkSQL functions with no DSL equivalent. It forces companies such

[GitHub] [spark] BryanCutler commented on issue #24867: [SPARK-28041][PYTHON] Increase minimum supported Pandas to 0.23.2

BryanCutler commented on issue #24867: [SPARK-28041][PYTHON] Increase minimum supported Pandas to 0.23.2 URL: https://github.com/apache/spark/pull/24867#issuecomment-502191681 > Could you update pandas_udf function note together? Thanks @dongjoon-hyun , that one is referencing the ta

[GitHub] [spark] SparkQA commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

SparkQA commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502190627 **[Test build #106525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502189786 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502189680 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502189796 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502189688 Test PASSed. Refer to this link for build results (access rights to C

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502189786 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502189796 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502189688 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502189680 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic.

AmplabJenkins removed a comment on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic. URL: https://github.com/apache/spark/pull/24873#issuecomment-502188521 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic.

AmplabJenkins removed a comment on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic. URL: https://github.com/apache/spark/pull/24873#issuecomment-502188525 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic.

AmplabJenkins commented on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic. URL: https://github.com/apache/spark/pull/24873#issuecomment-502188521 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic.

AmplabJenkins commented on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic. URL: https://github.com/apache/spark/pull/24873#issuecomment-502188525 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502186715 Test FAILed. Refer to this link for build results (a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24842: [SPARK-28002][SQL] Support WITH clause column aliases

AmplabJenkins removed a comment on issue #24842: [SPARK-28002][SQL] Support WITH clause column aliases URL: https://github.com/apache/spark/pull/24842#issuecomment-502186806 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins removed a comment on issue #24842: [SPARK-28002][SQL] Support WITH clause column aliases

AmplabJenkins removed a comment on issue #24842: [SPARK-28002][SQL] Support WITH clause column aliases URL: https://github.com/apache/spark/pull/24842#issuecomment-502186795 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] liancheng commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

liancheng commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502188108 ok to test This is

[GitHub] [spark] SparkQA removed a comment on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic.

SparkQA removed a comment on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic. URL: https://github.com/apache/spark/pull/24873#issuecomment-502119731 **[Test build #106517 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

AmplabJenkins removed a comment on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-501917683 Can one of the admins verify this patch? --

[GitHub] [spark] liancheng commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression

liancheng commented on issue #24866: [WIP][SQL] Micro-optimization to avoid expensive reference computation in QueryPlan and Expression URL: https://github.com/apache/spark/pull/24866#issuecomment-502188231 add to whitelist T

[GitHub] [spark] SparkQA commented on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic.

SparkQA commented on issue #24873: [SPARK-28052][SQL] Make `ArrayExists` follow the three-valued boolean logic. URL: https://github.com/apache/spark/pull/24873#issuecomment-502187937 **[Test build #106517 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1065

[GitHub] [spark] AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502186698 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-502187550 **[Test build #106524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106524/tes

[GitHub] [spark] SparkQA commented on issue #24842: [SPARK-28002][SQL] Support WITH clause column aliases

SparkQA commented on issue #24842: [SPARK-28002][SQL] Support WITH clause column aliases URL: https://github.com/apache/spark/pull/24842#issuecomment-502187510 **[Test build #106523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106523/testReport)** for PR

[GitHub] [spark] SparkQA removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

SparkQA removed a comment on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502154053 **[Test build #106519 has started](https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502186698 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series

AmplabJenkins commented on issue #24643: [SPARK-26412][PySpark][SQL] Allow Pandas UDF to take an iterator of pd.Series or an iterator of tuple of pd.Series URL: https://github.com/apache/spark/pull/24643#issuecomment-502186715 Test FAILed. Refer to this link for build results (access rig

[GitHub] [spark] AmplabJenkins commented on issue #24842: [SPARK-28002][SQL] Support WITH clause column aliases

AmplabJenkins commented on issue #24842: [SPARK-28002][SQL] Support WITH clause column aliases URL: https://github.com/apache/spark/pull/24842#issuecomment-502186795 Merged build finished. Test PASSed. This is an automated me

<    1   2   3   4   5   6   >