[GitHub] spark issue #20400: [SPARK-23084][PYTHON]Add unboundedPreceding(), unbounded...

Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/20400 LGTM only one nit --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20400: [SPARK-23084][PYTHON]Add unboundedPreceding(), un...

Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/20400#discussion_r164950347 --- Diff: python/pyspark/sql/window.py --- @@ -124,16 +126,20 @@ def rangeBetween(start, end): values directly. :param

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86857/ Test FAILed. ---

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20445 **[Test build #86857 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86857/testReport)** for PR 20445 at commit

[GitHub] spark issue #20400: [SPARK-23084][PYTHON]Add unboundedPreceding(), unbounded...

Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/20400 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20443: [SPARK-23157][SQL][FOLLOW-UP] DataFrame -> SparkDataFram...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20443 cc @felixcheung Could you take a look at this? Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter w...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20444 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter when the...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20444 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86851/ Test PASSed. ---

[GitHub] spark issue #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter when the...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20444 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter when the...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20444 Thanks! Merged to master/2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter when the...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/20444 Yeah, I see. LGTM. On Wed, Jan 31, 2018, 1:03 PM Xiao Li wrote: > *@gatorsmile* commented on this pull request. > -- >

[GitHub] spark issue #20440: [SPARK-23276][SQL][TEST] Enable UDT tests in (Hive)OrcHa...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20440 Thank you, @HyukjinKwon and @gatorsmile ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter when the...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20444 **[Test build #86851 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86851/testReport)** for PR 20444 at commit

[GitHub] spark pull request #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter w...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20444#discussion_r164948893 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/ReplaceExceptWithFilter.scala --- @@ -46,18 +46,27 @@ object

[GitHub] spark issue #20226: [SPARK-23034][SQL] Override `nodeName` for all *ScanExec...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20226 It sounds like we still need to fix a test in PySpark. Thanks! --- - To unsubscribe, e-mail:

[GitHub] spark pull request #20442: [SPARK-23265][SQL]Update multi-column error handl...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20442#discussion_r164945559 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala --- @@ -167,25 +167,31 @@ final class QuantileDiscretizer

[GitHub] spark pull request #20442: [SPARK-23265][SQL]Update multi-column error handl...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20442#discussion_r164939903 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala --- @@ -167,25 +167,31 @@ final class QuantileDiscretizer

[GitHub] spark issue #20382: [SPARK-23097][SQL][SS] Migrate text socket source to V2

Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20382 Sure, will waiting for others to be merged, thanks @tdas . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #20447: [SPARK-23279][SS] Avoid triggering distributed job for C...

Github user tdas commented on the issue: https://github.com/apache/spark/pull/20447 Thank you very much for fixing this. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20382: [SPARK-23097][SQL][SS] Migrate text socket source to V2

Github user tdas commented on the issue: https://github.com/apache/spark/pull/20382 I am holding off further comments on this PR until the major change of eliminating v1 Source is done. That would cause significant refactoring (including the fact that the common trait wont be

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164944650 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -47,130 +48,141 @@ object TextSocketSource { * This

[GitHub] spark pull request #20438: [SPARK-23272][SQL] add calendar interval type sup...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20438#discussion_r164944493 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/MutableColumnarRow.java --- @@ -146,9 +146,7 @@ public UTF8String

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164944362 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TextSocketReader.scala --- @@ -0,0 +1,133 @@ +/* + * Licensed to the

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164944324 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -47,130 +48,141 @@ object TextSocketSource { * This

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164944276 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -47,130 +48,141 @@ object TextSocketSource { * This

[GitHub] spark pull request #20438: [SPARK-23272][SQL] add calendar interval type sup...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20438#discussion_r164943981 --- Diff: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarRow.java --- @@ -139,9 +139,7 @@ public UTF8String getUTF8String(int ordinal) {

[GitHub] spark pull request #20438: [SPARK-23272][SQL] add calendar interval type sup...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20438#discussion_r164943754 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/MutableColumnarRow.java --- @@ -146,9 +146,7 @@ public UTF8String

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164943885 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -47,130 +48,141 @@ object TextSocketSource { *

[GitHub] spark issue #20438: [SPARK-23272][SQL] add calendar interval type support to...

Github user ueshin commented on the issue: https://github.com/apache/spark/pull/20438 LGTM. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20435: [SPARK-23268][SQL]Reorganize packages in data sou...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20435#discussion_r164943009 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceOffset.scala --- @@ -20,14 +20,16 @@ package

[GitHub] spark pull request #20438: [SPARK-23272][SQL] add calendar interval type sup...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20438#discussion_r164942783 --- Diff: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnVector.java --- @@ -236,9 +238,29 @@ public MapData getMap(int ordinal) {

[GitHub] spark issue #20415: [SPARK-23247][SQL]combines Unsafe operations and statist...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20415 **[Test build #86860 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86860/testReport)** for PR 20415 at commit

[GitHub] spark issue #20415: [SPARK-23247][SQL]combines Unsafe operations and statist...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20415 looks like a reasonable change to me. Although I don't think this will have some significant performance improvement, it makes the code more compact. ---

[GitHub] spark issue #20415: [SPARK-23247][SQL]combines Unsafe operations and statist...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20415 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #17280: [SPARK-19939] [ML] Add support for association ru...

Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/17280#discussion_r164942458 --- Diff: mllib/src/main/scala/org/apache/spark/ml/fpm/FPGrowth.scala --- @@ -319,9 +323,11 @@ object FPGrowthModel extends MLReadable[FPGrowthModel] {

[GitHub] spark issue #20433: [SPARK-23264][SQL] Support interval values without INTER...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20433 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86849/ Test PASSed. ---

[GitHub] spark issue #20433: [SPARK-23264][SQL] Support interval values without INTER...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20433 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20226: [SPARK-23034][SQL] Override `nodeName` for all *ScanExec...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20226 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86850/ Test FAILed. ---

[GitHub] spark issue #20226: [SPARK-23034][SQL] Override `nodeName` for all *ScanExec...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20226 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20433: [SPARK-23264][SQL] Support interval values without INTER...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20433 **[Test build #86849 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86849/testReport)** for PR 20433 at commit

[GitHub] spark issue #20226: [SPARK-23034][SQL] Override `nodeName` for all *ScanExec...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20226 **[Test build #86850 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86850/testReport)** for PR 20226 at commit

[GitHub] spark issue #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter when the...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20444 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19340: [SPARK-22119][ML] Add cosine distance to KMeans

Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/19340 The updating of centers should be viewed as the **M-step** in EM algorithm, in which some objective is optimized. Since cosine similarity do not take vector-norm into account: 1.

[GitHub] spark issue #20447: [SPARK-23279][SS] Avoid triggering distributed job for C...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20447 **[Test build #86859 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86859/testReport)** for PR 20447 at commit

[GitHub] spark issue #20447: [SPARK-23279][SS] Avoid triggering distributed job for C...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20447 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20447: [SPARK-23279][SS] Avoid triggering distributed job for C...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20447 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/415/

[GitHub] spark issue #20447: [SPARK-23279][SS] Avoid triggering distributed job for C...

Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20447 CC @tdas , please help to review. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20447: [SPARK-23279][SS] Avoid triggering distributed jo...

GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/20447 [SPARK-23279][SS] Avoid triggering distributed job for Console sink ## What changes were proposed in this pull request? Console sink will redistribute collected local data and trigger a

[GitHub] spark issue #20437: [SPARK-23270][Streaming][WEB-UI]FileInputDStream Streami...

Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/20437 thanks, Thank you for your review. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer.commit ...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20386 `FileCommitProtocol.onTaskCommit` is called in `FileFormatWriter.write`, so this PR is required to migrate file-based data sources. By a quick look, it seems

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164937540 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -47,130 +48,141 @@ object TextSocketSource { * This

[GitHub] spark issue #20408: [SPARK-23189][Core][Web UI] Reflect stage level blacklis...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20408 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86846/ Test PASSed. ---

[GitHub] spark issue #20408: [SPARK-23189][Core][Web UI] Reflect stage level blacklis...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20408 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20422: [SPARK-23253][Core][Shuffle]Only write shuffle temporary...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20422 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20422: [SPARK-23253][Core][Shuffle]Only write shuffle temporary...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20422 **[Test build #86858 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86858/testReport)** for PR 20422 at commit

[GitHub] spark issue #20378: [SPARK-11222][Build][Python] Python document style check...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20378 pydocstyle seems claiming PEP 257 - https://www.python.org/dev/peps/pep-0257. One option given https://github.com/apache/spark/pull/20378#issuecomment-361494109 and

[GitHub] spark issue #20422: [SPARK-23253][Core][Shuffle]Only write shuffle temporary...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20422 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/414/

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/413/

[GitHub] spark pull request #20444: [SPARK-23274] [SQL] Fix ReplaceExceptWithFilter w...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20444#discussion_r164937374 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/ReplaceExceptWithFilter.scala --- @@ -46,18 +46,27 @@ object

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20408: [SPARK-23189][Core][Web UI] Reflect stage level blacklis...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20408 **[Test build #86846 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86846/testReport)** for PR 20408 at commit

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20445 **[Test build #86857 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86857/testReport)** for PR 20445 at commit

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20446 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86856/ Test PASSed. ---

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20446 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20446 **[Test build #86856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86856/testReport)** for PR 20446 at commit

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164934753 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/ConsoleWriter.scala --- @@ -56,7 +58,7 @@ trait ConsoleWriter extends

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20373 **[Test build #86852 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86852/testReport)** for PR 20373 at commit

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86852/ Test PASSed. ---

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20373 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20446 **[Test build #86856 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86856/testReport)** for PR 20446 at commit

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20446 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/412/

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20446 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20446: [SPARK-23254][ML] Add user guide entry for DataFrame mul...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/20446 @MLnick @MrBago Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20446: [SPARK-23254][ML] Add user guide entry for DataFr...

GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/20446 [SPARK-23254][ML] Add user guide entry for DataFrame multivariate summary ## What changes were proposed in this pull request? Add user guide and scala/java examples for

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20445 **[Test build #86855 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86855/testReport)** for PR 20445 at commit

[GitHub] spark pull request #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSo...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20445#discussion_r164933558 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceReaderHolder.scala --- @@ -28,9 +28,9 @@ import

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20279: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/20279 Closed in favor of #20445 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/411/

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164933597 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -47,130 +48,141 @@ object TextSocketSource { * This

[GitHub] spark pull request #20279: [SPARK-23092][SQL] Migrate MemoryStream to DataSo...

Github user brkyvz closed the pull request at: https://github.com/apache/spark/pull/20279 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20373 Wait .. @BryanCutler, did you port the formatting one here ..? I was thinking we should match it to v0.4.2 as same as possible to reduce the diff. ---

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r164933166 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark pull request #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSo...

GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/20445 [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 APIs ## What changes were proposed in this pull request? This PR migrates the MemoryStream to DataSourceV2 APIs. It fixes a few things

[GitHub] spark issue #20279: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20279 **[Test build #86854 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86854/testReport)** for PR 20279 at commit

[GitHub] spark issue #20279: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20279 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/410/

[GitHub] spark issue #20279: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20279 Build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r164932125 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark issue #20279: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20279 **[Test build #86853 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86853/testReport)** for PR 20279 at commit

[GitHub] spark issue #20279: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20279 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/409/

[GitHub] spark issue #20279: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20279 Build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164930581 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -47,130 +48,141 @@ object TextSocketSource { * This

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r164930522 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/DataSourceWriter.java --- @@ -63,32 +68,42 @@ DataWriterFactory

[GitHub] spark pull request #20382: [SPARK-23097][SQL][SS] Migrate text socket source...

Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/20382#discussion_r164930523 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/ConsoleWriter.scala --- @@ -56,7 +58,7 @@ trait ConsoleWriter extends

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20373 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/408/

[GitHub] spark pull request #20440: [SPARK-23276][SQL][TEST] Enable UDT tests in (Hiv...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20440 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20440: [SPARK-23276][SQL][TEST] Enable UDT tests in (Hive)OrcHa...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20440 Thanks! Merged to master/2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20373 **[Test build #86852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86852/testReport)** for PR 20373 at commit

<    1   2   3   4   5   6   7   >