[GitHub] spark issue #23053: [SPARK-25957][K8S] Add ability to skip building optional...

2018-11-19 Thread mccheah
Github user mccheah commented on the issue: https://github.com/apache/spark/pull/23053 Hm, reviewing this again I think a better way to do it is to only opt-in to building images of different bindings. So for example the Python image should only be built when `-p ` is specified. It

[GitHub] spark pull request #23000: [SPARK-26002][SQL] Fix day of year calculation fo...

2018-11-19 Thread bersprockets
Github user bersprockets commented on a diff in the pull request: https://github.com/apache/spark/pull/23000#discussion_r234819827 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala --- @@ -410,6 +410,30 @@ class DateTimeUtilsSuite

[GitHub] spark issue #22635: [SPARK-25591][PySpark][SQL] Avoid overwriting deserializ...

2018-11-19 Thread Tagar
Github user Tagar commented on the issue: https://github.com/apache/spark/pull/22635 Thank you @viirya --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #22635: [SPARK-25591][PySpark][SQL] Avoid overwriting deserializ...

2018-11-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/22635 @Tagar I will look into it. Thanks. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #22612: [SPARK-24958] Add executors' process tree total m...

2018-11-19 Thread rezasafi
Github user rezasafi commented on a diff in the pull request: https://github.com/apache/spark/pull/22612#discussion_r234815376 --- Diff: core/src/main/scala/org/apache/spark/executor/ProcfsBasedSystems.scala --- @@ -0,0 +1,228 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #23072: [SPARK-19827][R]spark.ml R API for PIC

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23072 **[Test build #99028 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99028/testReport)** for PR 23072 at commit

[GitHub] spark issue #23072: [SPARK-19827][R]spark.ml R API for PIC

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23072 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23072: [SPARK-19827][R]spark.ml R API for PIC

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23072 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23072: [SPARK-19827][R]spark.ml R API for PIC

2018-11-19 Thread huaxingao
Github user huaxingao commented on the issue: https://github.com/apache/spark/pull/23072 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21688: [SPARK-21809] : Change Stage Page to use datatables to s...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21688 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99011/ Test PASSed. ---

[GitHub] spark issue #21688: [SPARK-21809] : Change Stage Page to use datatables to s...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21688 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21688: [SPARK-21809] : Change Stage Page to use datatables to s...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21688 **[Test build #99011 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99011/testReport)** for PR 21688 at commit

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23037 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23037 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5154/ ---

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23037 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23092: [SPARK-26094][CORE][STREAMING] createNonEcFile creates p...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23092 **[Test build #99027 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99027/testReport)** for PR 23092 at commit

[GitHub] spark issue #23092: [SPARK-26094][CORE][STREAMING] createNonEcFile creates p...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23092 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23092: [SPARK-26094][CORE][STREAMING] createNonEcFile creates p...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23092 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #23092: [SPARK-26094][CORE][STREAMING] createNonEcFile cr...

2018-11-19 Thread squito
GitHub user squito opened a pull request: https://github.com/apache/spark/pull/23092 [SPARK-26094][CORE][STREAMING] createNonEcFile creates parent dirs. ## What changes were proposed in this pull request? We explicitly avoid files with hdfs erasure coding for the streaming

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23037 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23037 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99026/ Test PASSed. ---

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23037 **[Test build #99026 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99026/testReport)** for PR 23037 at commit

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23037 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/5154/ ---

[GitHub] spark pull request #23000: [SPARK-26002][SQL] Fix day of year calculation fo...

2018-11-19 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/23000#discussion_r234807971 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala --- @@ -410,6 +410,30 @@ class DateTimeUtilsSuite extends

[GitHub] spark issue #23087: [MINOR][BUILD] Update plugins to latest versions

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23087 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23087: [MINOR][BUILD] Update plugins to latest versions

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23087 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99001/ Test PASSed. ---

[GitHub] spark issue #23087: [MINOR][BUILD] Update plugins to latest versions

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23087 **[Test build #99001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99001/testReport)** for PR 23087 at commit

[GitHub] spark issue #23084: [SPARK-26117][CORE][SQL]use SparkOutOfMemoryError instea...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23084 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99002/ Test PASSed. ---

[GitHub] spark issue #23084: [SPARK-26117][CORE][SQL]use SparkOutOfMemoryError instea...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23084 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23084: [SPARK-26117][CORE][SQL]use SparkOutOfMemoryError instea...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23084 **[Test build #99002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99002/testReport)** for PR 23084 at commit

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread AzureQ
Github user AzureQ commented on the issue: https://github.com/apache/spark/pull/23037 @ifilonenko I added the test case in `PythonTestsSuites` since it's pyspark specific. --- - To unsubscribe, e-mail:

[GitHub] spark issue #23037: [SPARK-26083][k8s] Add Copy pyspark into corresponding d...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23037 **[Test build #99026 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99026/testReport)** for PR 23037 at commit

[GitHub] spark issue #23038: [SPARK-25451][SPARK-26100][CORE]Aggregated metrics table...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23038 **[Test build #99025 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99025/testReport)** for PR 23038 at commit

[GitHub] spark issue #23038: [SPARK-25451][SPARK-26100][CORE]Aggregated metrics table...

2018-11-19 Thread shahidki31
Github user shahidki31 commented on the issue: https://github.com/apache/spark/pull/23038 It is a random failure. Jenkins, retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #23038: [SPARK-25451][SPARK-26100][CORE]Aggregated metrics table...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23038 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23038: [SPARK-25451][SPARK-26100][CORE]Aggregated metrics table...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23038 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99012/ Test FAILed. ---

[GitHub] spark issue #23038: [SPARK-25451][SPARK-26100][CORE]Aggregated metrics table...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23038 **[Test build #99012 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99012/testReport)** for PR 23038 at commit

[GitHub] spark issue #23081: [SPARK-26109][WebUI]Duration in the task summary metrics...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23081 **[Test build #99024 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99024/testReport)** for PR 23081 at commit

[GitHub] spark issue #23090: [SPARK-26118][Web UI] Introducing spark.ui.requestHeader...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23090 **[Test build #99023 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99023/testReport)** for PR 23090 at commit

[GitHub] spark issue #23081: [SPARK-26109][WebUI]Duration in the task summary metrics...

2018-11-19 Thread shahidki31
Github user shahidki31 commented on the issue: https://github.com/apache/spark/pull/23081 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23054 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99010/ Test PASSed. ---

[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23054 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #23090: [SPARK-26118][Web UI] Introducing spark.ui.reques...

2018-11-19 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/23090#discussion_r234799817 --- Diff: docs/configuration.md --- @@ -973,6 +973,14 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23054 **[Test build #99010 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99010/testReport)** for PR 23054 at commit

[GitHub] spark issue #23039: [SPARK-26066][SQL] Move truncatedString to sql/catalyst ...

2018-11-19 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/23039 @gatorsmile @hvanhovell Could you look at the PR, please. I extracted a piece of changes from #22429. --- - To unsubscribe,

[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23054 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99009/ Test PASSed. ---

[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23054 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23054 **[Test build #99009 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99009/testReport)** for PR 23054 at commit

[GitHub] spark issue #23027: [SPARK-26049][SQL][TEST] FilterPushdownBenchmark add InM...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23027 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23027: [SPARK-26049][SQL][TEST] FilterPushdownBenchmark add InM...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23027 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99007/ Test PASSed. ---

[GitHub] spark issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subq...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23057 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99008/ Test PASSed. ---

[GitHub] spark issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subq...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23057 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23027: [SPARK-26049][SQL][TEST] FilterPushdownBenchmark add InM...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23027 **[Test build #99007 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99007/testReport)** for PR 23027 at commit

[GitHub] spark issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subq...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23057 **[Test build #99008 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99008/testReport)** for PR 23057 at commit

[GitHub] spark pull request #23086: [SPARK-25528][SQL] data source v2 API refactor (b...

2018-11-19 Thread mccheah
Github user mccheah commented on a diff in the pull request: https://github.com/apache/spark/pull/23086#discussion_r234793177 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/TableProvider.java --- @@ -0,0 +1,62 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #22237: [SPARK-25243][SQL] Use FailureSafeParser in from_...

2018-11-19 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/22237#discussion_r234792965 --- Diff: R/pkg/tests/fulltests/test_sparkSQL.R --- @@ -1694,7 +1694,7 @@ test_that("column functions", { df <- as.DataFrame(list(list("col" =

[GitHub] spark issue #23081: [SPARK-26109][WebUI]Duration in the task summary metrics...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23081 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98998/ Test FAILed. ---

[GitHub] spark issue #23081: [SPARK-26109][WebUI]Duration in the task summary metrics...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23081 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23081: [SPARK-26109][WebUI]Duration in the task summary metrics...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23081 **[Test build #98998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98998/testReport)** for PR 23081 at commit

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22305 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22305 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22305 **[Test build #99022 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99022/testReport)** for PR 22305 at commit

[GitHub] spark pull request #22305: [SPARK-24561][SQL][Python] User-defined window ag...

2018-11-19 Thread icexelloss
Github user icexelloss commented on a diff in the pull request: https://github.com/apache/spark/pull/22305#discussion_r234790479 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/python/WindowInPandasExec.scala --- @@ -27,17 +27,62 @@ import

[GitHub] spark pull request #22305: [SPARK-24561][SQL][Python] User-defined window ag...

2018-11-19 Thread icexelloss
Github user icexelloss commented on a diff in the pull request: https://github.com/apache/spark/pull/22305#discussion_r234790633 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/python/WindowInPandasExec.scala --- @@ -73,68 +118,151 @@ case class

[GitHub] spark pull request #22305: [SPARK-24561][SQL][Python] User-defined window ag...

2018-11-19 Thread icexelloss
Github user icexelloss commented on a diff in the pull request: https://github.com/apache/spark/pull/22305#discussion_r234790364 --- Diff: python/pyspark/sql/tests.py --- @@ -89,6 +89,7 @@ from pyspark.sql.types import _merge_type from pyspark.tests import QuietTest,

[GitHub] spark pull request #22305: [SPARK-24561][SQL][Python] User-defined window ag...

2018-11-19 Thread icexelloss
Github user icexelloss commented on a diff in the pull request: https://github.com/apache/spark/pull/22305#discussion_r234790403 --- Diff: python/pyspark/sql/tests.py --- @@ -7064,12 +7098,104 @@ def test_invalid_args(self): foo_udf = pandas_udf(lambda x: x, 'v

[GitHub] spark pull request #22237: [SPARK-25243][SQL] Use FailureSafeParser in from_...

2018-11-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/22237#discussion_r234789275 --- Diff: R/pkg/tests/fulltests/test_sparkSQL.R --- @@ -1694,7 +1694,7 @@ test_that("column functions", { df <- as.DataFrame(list(list("col" =

[GitHub] spark issue #23091: [SPARK-26122][SQL] Support encoding for multiLine in CSV...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23091 **[Test build #99021 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99021/testReport)** for PR 23091 at commit

[GitHub] spark issue #23091: [SPARK-26122][SQL] Support encoding for multiLine in CSV...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23091 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23091: [SPARK-26122][SQL] Support encoding for multiLine in CSV...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23091 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23091: [SPARK-26122][SQL] Support encoding for multiLine in CSV...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23091 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23072: [SPARK-19827][R]spark.ml R API for PIC

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23072 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99017/ Test FAILed. ---

[GitHub] spark issue #23091: [SPARK-26122][SQL] Support encoding for multiLine in CSV...

2018-11-19 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/23091 @HyukjinKwon Please, take a look at the PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23072: [SPARK-19827][R]spark.ml R API for PIC

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23072 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #23091: [SPARK-26122][SQL] Support encoding for multiLine...

2018-11-19 Thread MaxGekk
GitHub user MaxGekk opened a pull request: https://github.com/apache/spark/pull/23091 [SPARK-26122][SQL] Support encoding for multiLine in CSV datasource ## What changes were proposed in this pull request? In the PR, I propose to pass the CSV option `encoding`/`charset` to

[GitHub] spark issue #23072: [SPARK-19827][R]spark.ml R API for PIC

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23072 **[Test build #99017 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99017/testReport)** for PR 23072 at commit

[GitHub] spark issue #23084: [SPARK-26117][CORE][SQL]use SparkOutOfMemoryError instea...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23084 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23084: [SPARK-26117][CORE][SQL]use SparkOutOfMemoryError instea...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23084 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99006/ Test FAILed. ---

[GitHub] spark issue #23084: [SPARK-26117][CORE][SQL]use SparkOutOfMemoryError instea...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23084 **[Test build #99006 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99006/testReport)** for PR 23084 at commit

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22305 **[Test build #99020 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99020/testReport)** for PR 22305 at commit

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22305 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99020/ Test FAILed. ---

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22305 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22305 **[Test build #99020 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99020/testReport)** for PR 22305 at commit

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22305 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22305: [SPARK-24561][SQL][Python] User-defined window aggregati...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22305 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23053: [SPARK-25957][K8S] Add ability to skip building optional...

2018-11-19 Thread ramaddepally
Github user ramaddepally commented on the issue: https://github.com/apache/spark/pull/23053 @vanzin @ifilonenko @squito ... can you of you review and commit this change if you have no more objections. This has already passed all the tests. ---

[GitHub] spark pull request #23058: [SPARK-25905][CORE] When getting a remote block, ...

2018-11-19 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/23058#discussion_r234779890 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -693,9 +693,9 @@ private[spark] class BlockManager( */

[GitHub] spark issue #23090: [SPARK-26118][UI] Introducing spark.ui.requestHeaderSize...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23090 **[Test build #99019 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99019/testReport)** for PR 23090 at commit

[GitHub] spark issue #23090: [SPARK-26118][UI] Introducing spark.ui.requestHeaderSize...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23090 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23090: [SPARK-26118][UI] Introducing spark.ui.requestHeaderSize...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23090 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #22959: [SPARK-25876][k8s] Simplify kubernetes configurat...

2018-11-19 Thread liyinan926
Github user liyinan926 commented on a diff in the pull request: https://github.com/apache/spark/pull/22959#discussion_r234774528 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/HadoopConfExecutorFeatureStep.scala --- @@ -28,21

[GitHub] spark pull request #22959: [SPARK-25876][k8s] Simplify kubernetes configurat...

2018-11-19 Thread liyinan926
Github user liyinan926 commented on a diff in the pull request: https://github.com/apache/spark/pull/22959#discussion_r234775406 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfDriverFeatureStep.scala --- @@ -16,40

[GitHub] spark pull request #22959: [SPARK-25876][k8s] Simplify kubernetes configurat...

2018-11-19 Thread liyinan926
Github user liyinan926 commented on a diff in the pull request: https://github.com/apache/spark/pull/22959#discussion_r234773869 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DriverCommandFeatureStep.scala --- @@ -85,7 +83,7 @@

[GitHub] spark pull request #22959: [SPARK-25876][k8s] Simplify kubernetes configurat...

2018-11-19 Thread liyinan926
Github user liyinan926 commented on a diff in the pull request: https://github.com/apache/spark/pull/22959#discussion_r234774673 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfDriverFeatureStep.scala --- @@ -16,40

[GitHub] spark pull request #22959: [SPARK-25876][k8s] Simplify kubernetes configurat...

2018-11-19 Thread liyinan926
Github user liyinan926 commented on a diff in the pull request: https://github.com/apache/spark/pull/22959#discussion_r234773904 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DriverCommandFeatureStep.scala --- @@ -124,7 +122,7 @@

[GitHub] spark pull request #22959: [SPARK-25876][k8s] Simplify kubernetes configurat...

2018-11-19 Thread liyinan926
Github user liyinan926 commented on a diff in the pull request: https://github.com/apache/spark/pull/22959#discussion_r234774586 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/HadoopSparkUserExecutorFeatureStep.scala --- @@ -16,28

[GitHub] spark issue #23090: [SPARK-26118][UI] Introducing spark.ui.requestHeaderSize...

2018-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23090 **[Test build #99018 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99018/testReport)** for PR 23090 at commit

[GitHub] spark pull request #23090: [SPARK-26118][UI] Introducing spark.ui.requestHea...

2018-11-19 Thread attilapiros
GitHub user attilapiros opened a pull request: https://github.com/apache/spark/pull/23090 [SPARK-26118][UI] Introducing spark.ui.requestHeaderSize for setting HTTP requestHeaderSize ## What changes were proposed in this pull request? Introducing spark.ui.requestHeaderSize

[GitHub] spark issue #23089: [SPARK-26120][TESTS][SS][SPARKR]Fix a streaming query le...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23089 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23089: [SPARK-26120][TESTS][SS][SPARKR]Fix a streaming query le...

2018-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99015/ Test PASSed. ---

<    1   2   3   4   5   >