[GitHub] spark pull request #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user mn-mikke commented on a diff in the pull request: https://github.com/apache/spark/pull/21028#discussion_r184730604 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -19,14 +19,41 @@ package

[GitHub] spark pull request #21182: [SPARK-24068] Propagating DataFrameReader's optio...

GitHub user MaxGekk opened a pull request: https://github.com/apache/spark/pull/21182 [SPARK-24068] Propagating DataFrameReader's options to Text datasource on schema inferring ## What changes were proposed in this pull request? While reading CSV or JSON files,

[GitHub] spark issue #21181: [SPARK-23736][SQL][FOLLOWUP] Error message should contai...

Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21181 cc @mn-mikke @ueshin --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21181: [SPARK-23736][SQL][FOLLOWUP] Error message should contai...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21181 **[Test build #89927 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89927/testReport)** for PR 21181 at commit

[GitHub] spark issue #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully method ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21175 **[Test build #89928 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89928/testReport)** for PR 21175 at commit

[GitHub] spark issue #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully method ...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21175 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21181: [SPARK-23736][SQL][FOLLOWUP] Error message should...

GitHub user mgaido91 opened a pull request: https://github.com/apache/spark/pull/21181 [SPARK-23736][SQL][FOLLOWUP] Error message should contains SQL types ## What changes were proposed in this pull request? In the error messages we should return the SQL types (like

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user manbuyun commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184728954 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala --- @@ -63,10 +63,12 @@ private[spark] class ChunkedByteBuffer(var chunks:

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user manbuyun commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184727560 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala --- @@ -63,10 +63,12 @@ private[spark] class ChunkedByteBuffer(var chunks:

[GitHub] spark issue #21141: [SPARK-23853][PYSPARK][TEST] Run Hive-related PySpark te...

Github user bersprockets commented on the issue: https://github.com/apache/spark/pull/21141 @dongjoon-hyun @HyukjinKwon My PR is no longer addressing the issue described its associated Jira [(SPARK-23776),](https://issues.apache.org/jira/browse/SPARK-23776) which is that developers

[GitHub] spark issue #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21028 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2720/

[GitHub] spark issue #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21028 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21177: [SPARK-24111][SQL] Add the TPCDS v2.7 (latest) qu...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/21177#discussion_r184725980 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala --- @@ -78,7 +81,7 @@ object TPCDSQueryBenchmark

[GitHub] spark pull request #21177: [SPARK-24111][SQL] Add the TPCDS v2.7 (latest) qu...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/21177#discussion_r184724132 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala --- @@ -87,10 +90,20 @@ object

[GitHub] spark issue #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21028 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89926/ Test FAILed. ---

[GitHub] spark issue #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21028 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21028 **[Test build #89926 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89926/testReport)** for PR 21028 at commit

[GitHub] spark issue #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21028 **[Test build #89926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89926/testReport)** for PR 21028 at commit

[GitHub] spark pull request #21136: [SPARK-24061][SS]Add TypedFilter support for cont...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/21136#discussion_r184719162 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala --- @@ -771,6 +778,16 @@ class

[GitHub] spark pull request #21136: [SPARK-24061][SS]Add TypedFilter support for cont...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/21136#discussion_r184718790 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala --- @@ -840,4 +857,9 @@ class

[GitHub] spark pull request #20946: [SPARK-23565] [SS] New error message for structur...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20946 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20946: [SPARK-23565] [SS] New error message for structured stre...

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/20946 Thanks! Merging to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184713695 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala --- @@ -63,10 +63,12 @@ private[spark] class ChunkedByteBuffer(var

[GitHub] spark issue #21180: [SPARK-22674][PYTHON] Disabled _hack_namedtuple for pick...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21180 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21180: [SPARK-22674][PYTHON] Disabled _hack_namedtuple for pick...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21180 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21180: [SPARK-22674][PYTHON] Disabled _hack_namedtuple f...

GitHub user superbobry opened a pull request: https://github.com/apache/spark/pull/21180 [SPARK-22674][PYTHON] Disabled _hack_namedtuple for picklable namedtuples Prior to this PR ``_hack_namedtuple`` was applied to all namedtuples, regardless if they were defined on the top

[GitHub] spark issue #21157: [SPARK-22674][PYTHON] Removed the namedtuple pickling pa...

Github user superbobry commented on the issue: https://github.com/apache/spark/pull/21157 Closing in favour of #21180. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #21157: [SPARK-22674][PYTHON] Removed the namedtuple pick...

Github user superbobry closed the pull request at: https://github.com/apache/spark/pull/21157 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21133: [SPARK-24013][SQL] Remove unneeded compress in Approxima...

Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/21133 cc @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21028#discussion_r184706765 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -288,6 +288,114 @@ case class

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user manbuyun commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184706100 --- Diff: core/src/test/scala/org/apache/spark/io/ChunkedByteBufferSuite.scala --- @@ -56,6 +56,15 @@ class ChunkedByteBufferSuite extends SparkFunSuite {

[GitHub] spark issue #21153: [SPARK-24058][ML][PySpark] Default Params in ML should b...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21153 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89924/ Test PASSed. ---

[GitHub] spark issue #21153: [SPARK-24058][ML][PySpark] Default Params in ML should b...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21153 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21133: [SPARK-24013][SQL] Remove unneeded compress in Approxima...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21133 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21153: [SPARK-24058][ML][PySpark] Default Params in ML should b...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21153 **[Test build #89924 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89924/testReport)** for PR 21153 at commit

[GitHub] spark issue #21133: [SPARK-24013][SQL] Remove unneeded compress in Approxima...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89921/ Test PASSed. ---

[GitHub] spark issue #21133: [SPARK-24013][SQL] Remove unneeded compress in Approxima...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21133 **[Test build #89921 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89921/testReport)** for PR 21133 at commit

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21021 **[Test build #89925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89925/testReport)** for PR 21021 at commit

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21021 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2719/

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21021 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/21021 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user mn-mikke commented on a diff in the pull request: https://github.com/apache/spark/pull/21028#discussion_r184700686 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -288,6 +288,114 @@ case class

[GitHub] spark issue #21153: [SPARK-24058][ML][PySpark] Default Params in ML should b...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21153 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2718/

[GitHub] spark issue #21153: [SPARK-24058][ML][PySpark] Default Params in ML should b...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21153 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21153: [SPARK-24058][ML][PySpark] Default Params in ML should b...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21153 **[Test build #89924 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89924/testReport)** for PR 21153 at commit

[GitHub] spark pull request #21153: [SPARK-24058][ML][PySpark] Default Params in ML s...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21153#discussion_r184693332 --- Diff: python/pyspark/ml/util.py --- @@ -417,15 +419,24 @@ def _get_metadata_to_save(instance, sc, extraMetadata=None, paramMap=None): """

[GitHub] spark pull request #21153: [SPARK-24058][ML][PySpark] Default Params in ML s...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21153#discussion_r184693307 --- Diff: python/pyspark/ml/util.py --- @@ -417,15 +419,24 @@ def _get_metadata_to_save(instance, sc, extraMetadata=None, paramMap=None): """

[GitHub] spark pull request #21169: [SPARK-23715][SQL] the input of to/from_utc_times...

Github user bersprockets commented on a diff in the pull request: https://github.com/apache/spark/pull/21169#discussion_r184687634 --- Diff: sql/core/src/test/resources/sql-tests/results/datetime.sql.out --- @@ -82,9 +82,138 @@ struct 1 2 2 3 +

[GitHub] spark issue #21040: [SPARK-23930][SQL] Add slice function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21040 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2717/

[GitHub] spark issue #21040: [SPARK-23930][SQL] Add slice function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21040 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20604: [SPARK-23365][CORE] Do not adjust num executors when kil...

Github user Ngone51 commented on the issue: https://github.com/apache/spark/pull/20604 ping @squito --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21040: [SPARK-23930][SQL] Add slice function

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21040 **[Test build #89923 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89923/testReport)** for PR 21040 at commit

[GitHub] spark pull request #21169: [SPARK-23715][SQL] the input of to/from_utc_times...

Github user bersprockets commented on a diff in the pull request: https://github.com/apache/spark/pull/21169#discussion_r184685378 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -1208,6 +1208,13 @@ object SQLConf { .stringConf

[GitHub] spark pull request #21028: [SPARK-23922][SQL] Add arrays_overlap function

Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21028#discussion_r184683126 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -288,6 +288,114 @@ case class

[GitHub] spark issue #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserFromKeyt...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21178 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserFromKeyt...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89922/ Test PASSed. ---

[GitHub] spark issue #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserFromKeyt...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21178 **[Test build #89922 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89922/testReport)** for PR 21178 at commit

[GitHub] spark issue #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserFromKeyt...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2716/

[GitHub] spark issue #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserFromKeyt...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21178 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserFromKeyt...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21178 **[Test build #89922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89922/testReport)** for PR 21178 at commit

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184675304 --- Diff: core/src/test/scala/org/apache/spark/io/ChunkedByteBufferSuite.scala --- @@ -56,6 +56,15 @@ class ChunkedByteBufferSuite extends SparkFunSuite {

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21021 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89920/ Test FAILed. ---

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21021 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21021 **[Test build #89920 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89920/testReport)** for PR 21021 at commit

[GitHub] spark issue #21106: [SPARK-23711][SQL][WIP] Add fallback logic for UnsafePro...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/21106 A sql conf sounds good to me. @hvanhovell What do you think? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark pull request #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserF...

Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/21178#discussion_r184672313 --- Diff: sql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/HiveAuthFactory.java --- @@ -362,4 +371,34 @@ public static void

[GitHub] spark issue #21121: [SPARK-24042][SQL] Collection function: zip_with_index

Github user mn-mikke commented on the issue: https://github.com/apache/spark/pull/21121 @ueshin What about combining `zip_with_index` with [`map_from_entries`](https://issues.apache.org/jira/browse/SPARK-23934)? ---

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user manbuyun commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184668664 --- Diff: core/src/test/scala/org/apache/spark/io/ChunkedByteBufferSuite.scala --- @@ -56,6 +56,13 @@ class ChunkedByteBufferSuite extends SparkFunSuite {

[GitHub] spark issue #21121: [SPARK-24042][SQL] Collection function: zip_with_index

Github user lokm01 commented on the issue: https://github.com/apache/spark/pull/21121 @ueshin Currently we use our own implementation of zipWithIndex when we do explode and need to preserve the ordering of the array elements (especially if there is a shuffle involved in the

[GitHub] spark pull request #21040: [SPARK-23930][SQL] Add slice function

Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21040#discussion_r184666357 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -287,3 +287,101 @@ case class

[GitHub] spark issue #21174: [SPARK-24085][SQL] Query returns UnsupportedOperationExc...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21174 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89918/ Test PASSed. ---

[GitHub] spark issue #21174: [SPARK-24085][SQL] Query returns UnsupportedOperationExc...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21174 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21174: [SPARK-24085][SQL] Query returns UnsupportedOperationExc...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21174 **[Test build #89918 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89918/testReport)** for PR 21174 at commit

[GitHub] spark pull request #21133: [SPARK-24013][SQL] Remove unneeded compress in Ap...

Github user juliuszsompolski commented on a diff in the pull request: https://github.com/apache/spark/pull/21133#discussion_r184662359 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ApproximatePercentileQuerySuite.scala --- @@ -279,4 +282,11 @@ class

[GitHub] spark issue #21143: [SPARK-24072][SQL] clearly define pushed filters

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21143 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21143: [SPARK-24072][SQL] clearly define pushed filters

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21143 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89919/ Test PASSed. ---

[GitHub] spark issue #21143: [SPARK-24072][SQL] clearly define pushed filters

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21143 **[Test build #89919 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89919/testReport)** for PR 21143 at commit

[GitHub] spark pull request #21133: [SPARK-24013][SQL] Remove unneeded compress in Ap...

Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21133#discussion_r184658151 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ApproximatePercentileQuerySuite.scala --- @@ -279,4 +282,11 @@ class

[GitHub] spark pull request #21133: [SPARK-24013][SQL] Remove unneeded compress in Ap...

Github user juliuszsompolski commented on a diff in the pull request: https://github.com/apache/spark/pull/21133#discussion_r184656896 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ApproximatePercentileQuerySuite.scala --- @@ -279,4 +282,11 @@ class

[GitHub] spark issue #21133: [SPARK-24013][SQL] Remove unneeded compress in Approxima...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2715/

[GitHub] spark issue #21133: [SPARK-24013][SQL] Remove unneeded compress in Approxima...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21133 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21133: [SPARK-24013][SQL] Remove unneeded compress in Approxima...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21133 **[Test build #89921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89921/testReport)** for PR 21133 at commit

[GitHub] spark pull request #21133: [SPARK-24013][SQL] Remove unneeded compress in Ap...

Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21133#discussion_r184654618 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/ApproximatePercentile.scala --- @@ -238,12 +238,6 @@ object

[GitHub] spark pull request #21133: [SPARK-24013][SQL] Remove unneeded compress in Ap...

Github user juliuszsompolski commented on a diff in the pull request: https://github.com/apache/spark/pull/21133#discussion_r184654132 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/ApproximatePercentile.scala --- @@ -238,12 +238,6 @@

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21021 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21021 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2714/

[GitHub] spark pull request #21133: [SPARK-24013][SQL] Remove unneeded compress in Ap...

Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21133#discussion_r184653021 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ApproximatePercentileQuerySuite.scala --- @@ -279,4 +282,10 @@ class

[GitHub] spark pull request #21133: [SPARK-24013][SQL] Remove unneeded compress in Ap...

Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/21133#discussion_r184652876 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/ApproximatePercentile.scala --- @@ -238,12 +238,6 @@ object

[GitHub] spark issue #21177: [SPARK-24111][SQL] Add the TPCDS v2.7 (latest) queries i...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21177 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89916/ Test PASSed. ---

[GitHub] spark issue #21177: [SPARK-24111][SQL] Add the TPCDS v2.7 (latest) queries i...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21177 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21177: [SPARK-24111][SQL] Add the TPCDS v2.7 (latest) queries i...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21177 **[Test build #89916 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89916/testReport)** for PR 21177 at commit

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21021 **[Test build #89920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89920/testReport)** for PR 21021 at commit

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184645573 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala --- @@ -63,10 +63,12 @@ private[spark] class ChunkedByteBuffer(var chunks:

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184644678 --- Diff: core/src/test/scala/org/apache/spark/io/ChunkedByteBufferSuite.scala --- @@ -56,6 +56,13 @@ class ChunkedByteBufferSuite extends SparkFunSuite {

[GitHub] spark pull request #21175: [SPARK-24107][CORE] ChunkedByteBuffer.writeFully ...

Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21175#discussion_r184644454 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala --- @@ -63,10 +63,12 @@ private[spark] class ChunkedByteBuffer(var chunks:

[GitHub] spark pull request #21166: [SPARK-11334][CORE] clear idle executors in execu...

Github user sadhen closed the pull request at: https://github.com/apache/spark/pull/21166 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21166: [SPARK-11334][CORE] clear idle executors in executorIdTo...

Github user sadhen commented on the issue: https://github.com/apache/spark/pull/21166 I have checked the latest master code. ``` scala // If the executor is no longer running any scheduled tasks, mark it as idle if

[GitHub] spark pull request #21166: [SPARK-11334][CORE] clear idle executors in execu...

GitHub user sadhen reopened a pull request: https://github.com/apache/spark/pull/21166 [SPARK-11334][CORE] clear idle executors in executorIdToTaskIds keySet ## What changes were proposed in this pull request? quote from #11205 > Executors may never be idle.

[GitHub] spark pull request #21153: [SPARK-24058][ML][PySpark] Default Params in ML s...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21153#discussion_r184632888 --- Diff: python/pyspark/ml/util.py --- @@ -523,11 +534,29 @@ def getAndSetParams(instance, metadata): """ Extract Params from

[GitHub] spark pull request #21021: [SPARK-23921][SQL] Add array_sort function

Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21021#discussion_r184632402 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -185,6 +183,8 @@ trait ArraySortUtil

<    1   2   3   4   >