[GitHub] [spark] HyukjinKwon commented on a change in pull request #26239: [SPARK-29582][PYSPARK] Support `TaskContext.get()` in a barrier task from Python side

2019-10-30 Thread GitBox
HyukjinKwon commented on a change in pull request #26239: [SPARK-29582][PYSPARK] Support `TaskContext.get()` in a barrier task from Python side URL: https://github.com/apache/spark/pull/26239#discussion_r340931081 ## File path: python/pyspark/tests/test_taskcontext.py ##

[GitHub] [spark] yaooqinn commented on a change in pull request #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

2019-10-30 Thread GitBox
yaooqinn commented on a change in pull request #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#discussion_r340930931 ## File path: core/src/test/scala/org/apache/spark/storage/DiskBlockMan

[GitHub] [spark] yaooqinn commented on a change in pull request #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

2019-10-30 Thread GitBox
yaooqinn commented on a change in pull request #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#discussion_r340930931 ## File path: core/src/test/scala/org/apache/spark/storage/DiskBlockMan

[GitHub] [spark] AmplabJenkins removed a comment on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage URL: https://github.com/apache/spark/pull/26309#issuecomment-548182968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins commented on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage URL: https://github.com/apache/spark/pull/26309#issuecomment-548182968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins commented on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage URL: https://github.com/apache/spark/pull/26309#issuecomment-548182962 Merged build finished. Test PASSed. This i

[GitHub] [spark] SparkQA commented on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage

2019-10-30 Thread GitBox
SparkQA commented on issue #26309: [SPARK-29544] collect the runtime statistics of row count in map stage URL: https://github.com/apache/spark/pull/26309#issuecomment-548182739 **[Test build #112980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112980/test

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26239: [SPARK-29582][PYSPARK] Support `TaskContext.get()` in a barrier task from Python side

2019-10-30 Thread GitBox
HyukjinKwon commented on a change in pull request #26239: [SPARK-29582][PYSPARK] Support `TaskContext.get()` in a barrier task from Python side URL: https://github.com/apache/spark/pull/26239#discussion_r340930631 ## File path: python/pyspark/taskcontext.py ## @@ -162,7 +

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26239: [SPARK-29582][PYSPARK] Support `TaskContext.get()` in a barrier task from Python side

2019-10-30 Thread GitBox
HyukjinKwon commented on a change in pull request #26239: [SPARK-29582][PYSPARK] Support `TaskContext.get()` in a barrier task from Python side URL: https://github.com/apache/spark/pull/26239#discussion_r340930532 ## File path: python/pyspark/taskcontext.py ## @@ -162,7 +

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26239: [SPARK-29582][PYSPARK] Support `TaskContext.get()` in a barrier task from Python side

2019-10-30 Thread GitBox
HyukjinKwon commented on a change in pull request #26239: [SPARK-29582][PYSPARK] Support `TaskContext.get()` in a barrier task from Python side URL: https://github.com/apache/spark/pull/26239#discussion_r340930532 ## File path: python/pyspark/taskcontext.py ## @@ -162,7 +

[GitHub] [spark] AmplabJenkins removed a comment on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548181551 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548181546 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548181551 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548181546 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] HyukjinKwon closed pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide

2019-10-30 Thread GitBox
HyukjinKwon closed pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide URL: https://github.com/apache/spark/pull/26110 This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] HyukjinKwon commented on issue #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide

2019-10-30 Thread GitBox
HyukjinKwon commented on issue #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide URL: https://github.com/apache/spark/pull/26110#issuecomment-548181418 Merged to master. This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
SparkQA commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548181253 **[Test build #112979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112979/testReport)** for

[GitHub] [spark] cloud-fan commented on a change in pull request #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

2019-10-30 Thread GitBox
cloud-fan commented on a change in pull request #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#discussion_r340929253 ## File path: core/src/test/scala/org/apache/spark/storage/DiskBlockMa

[GitHub] [spark] cloud-fan commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
cloud-fan commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548179896 retest this please This is an automated message from the Apac

[GitHub] [spark] cloud-fan commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
cloud-fan commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548179953 LGTM This is an automated message from the Apache Git Service

[GitHub] [spark] AmplabJenkins removed a comment on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548178567 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548178567 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins removed a comment on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548178569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548178569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] SparkQA commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
SparkQA commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548178222 **[Test build #112978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112978/testReport)

[GitHub] [spark] viirya commented on a change in pull request #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file

2019-10-30 Thread GitBox
viirya commented on a change in pull request #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file URL: https://github.com/apache/spark/pull/26312#discussion_r340926443 ## File path: sql/core/src/test/scala/org/apache/spark/sq

[GitHub] [spark] cloud-fan closed pull request #26313: [SPARK-29651][SQL] Fix parsing of interval seconds fraction

2019-10-30 Thread GitBox
cloud-fan closed pull request #26313: [SPARK-29651][SQL] Fix parsing of interval seconds fraction URL: https://github.com/apache/spark/pull/26313 This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [spark] cloud-fan commented on issue #26313: [SPARK-29651][SQL] Fix parsing of interval seconds fraction

2019-10-30 Thread GitBox
cloud-fan commented on issue #26313: [SPARK-29651][SQL] Fix parsing of interval seconds fraction URL: https://github.com/apache/spark/pull/26313#issuecomment-548177530 thanks, merging to master! This is an automated message f

[GitHub] [spark] AmplabJenkins removed a comment on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548176568 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #26333: [SPARK-29677][DStreams] amazon-kinesis-client 1.12.0

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26333: [SPARK-29677][DStreams] amazon-kinesis-client 1.12.0 URL: https://github.com/apache/spark/pull/26333#issuecomment-548176575 Can one of the admins verify this patch? This is an

[GitHub] [spark] maropu commented on a change in pull request #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
maropu commented on a change in pull request #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#discussion_r340925840 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptio

[GitHub] [spark] AmplabJenkins removed a comment on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548176847 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #26333: [SPARK-29677][DStreams] amazon-kinesis-client 1.12.0

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26333: [SPARK-29677][DStreams] amazon-kinesis-client 1.12.0 URL: https://github.com/apache/spark/pull/26333#issuecomment-548176855 Can one of the admins verify this patch? This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548176847 Can one of the admins verify this patch? This is

[GitHub] [spark] maropu commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
maropu commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548176923 ok to test This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334#issuecomment-548176568 Can one of the admins verify this patch? This is

[GitHub] [spark] AmplabJenkins commented on issue #26333: [SPARK-29677][DStreams] amazon-kinesis-client 1.12.0

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26333: [SPARK-29677][DStreams] amazon-kinesis-client 1.12.0 URL: https://github.com/apache/spark/pull/26333#issuecomment-548176575 Can one of the admins verify this patch? This is an automate

[GitHub] [spark] ulysses-you opened a new pull request #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal

2019-10-30 Thread GitBox
ulysses-you opened a new pull request #26334: [SPARK-29675][SQL] Add exception when isolationLevel is Illegal URL: https://github.com/apache/spark/pull/26334 ### What changes were proposed in this pull request? Now we use JDBC api and set an Illegal isolationLevel option, spa

[GitHub] [spark] etspaceman opened a new pull request #26333: [SPARK-29677][DStreams] amazon-kinesis-client 1.12.0

2019-10-30 Thread GitBox
etspaceman opened a new pull request #26333: [SPARK-29677][DStreams] amazon-kinesis-client 1.12.0 URL: https://github.com/apache/spark/pull/26333 ### What changes were proposed in this pull request? Upgrading the amazon-kinesis-client dependency to 1.12.0. ### Why are the chan

[GitHub] [spark] rdblue closed pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown

2019-10-30 Thread GitBox
rdblue closed pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown URL: https://github.com/apache/spark/pull/25955 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] rdblue commented on issue #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown

2019-10-30 Thread GitBox
rdblue commented on issue #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown URL: https://github.com/apache/spark/pull/25955#issuecomment-548174875 Merging to master. Thanks for reviewing, @cloud-fan and @brkyvz! ---

[GitHub] [spark] AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548172241 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548172235 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548172241 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548172235 Merged build finished. Test PASSed.

[GitHub] [spark] srowen commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
srowen commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548172078 Oh, wait no I see the issue. Ganglia support is in a different module that I didn't enable. Indeed it isn't present in

[GitHub] [spark] SparkQA commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
SparkQA commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548171952 **[Test build #112977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] shaneknapp commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
shaneknapp commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548171335 test this please This is an automa

[GitHub] [spark] AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170857 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170871 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170857 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170871 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548170701 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548170701 Merged build finished. Test PASSed. Th

[GitHub] [spark] AmplabJenkins commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548170706 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548170706 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] SparkQA removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548136395 **[Test build #112968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] SparkQA commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
SparkQA commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170535 **[Test build #112968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170356 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170350 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
SparkQA commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548170398 **[Test build #112976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112976/

[GitHub] [spark] AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170350 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170356 Test FAILed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] SparkQA removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548145484 **[Test build #112972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] SparkQA commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests

2019-10-30 Thread GitBox
SparkQA commented on issue #26330: [WIP][SPARK-29672][PYSPARK] DO NOT MERGE -- remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330#issuecomment-548170197 **[Test build #112972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] maropu commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
maropu commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548169641 retest this please This is an automated messa

[GitHub] [spark] AmplabJenkins removed a comment on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file URL: https://github.com/apache/spark/pull/26312#issuecomment-548165944 Test PASSed. Refer to this link for build results (access rights t

[GitHub] [spark] AmplabJenkins removed a comment on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file URL: https://github.com/apache/spark/pull/26312#issuecomment-548165940 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file URL: https://github.com/apache/spark/pull/26312#issuecomment-548165940 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file URL: https://github.com/apache/spark/pull/26312#issuecomment-548165944 Test PASSed. Refer to this link for build results (access rights to CI ser

[GitHub] [spark] SparkQA commented on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file

2019-10-30 Thread GitBox
SparkQA commented on issue #26312: [SPARK-29649][SQL] Stop task set if FileAlreadyExistsException was thrown when writing to output file URL: https://github.com/apache/spark/pull/26312#issuecomment-548165655 **[Test build #112975 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spar

[GitHub] [spark] maropu commented on issue #26317: [SPARK-29628][SQL] Forcibly create a temporary view in CREATE VIEW if referencing a temporary view

2019-10-30 Thread GitBox
maropu commented on issue #26317: [SPARK-29628][SQL] Forcibly create a temporary view in CREATE VIEW if referencing a temporary view URL: https://github.com/apache/spark/pull/26317#issuecomment-548165652 btw, is this behaviour is common in the other DMBS-like? If no, better to add this fea

[GitHub] [spark] maropu commented on a change in pull request #26317: [SPARK-29628][SQL] Forcibly create a temporary view in CREATE VIEW if referencing a temporary view

2019-10-30 Thread GitBox
maropu commented on a change in pull request #26317: [SPARK-29628][SQL] Forcibly create a temporary view in CREATE VIEW if referencing a temporary view URL: https://github.com/apache/spark/pull/26317#discussion_r340915421 ## File path: sql/core/src/main/scala/org/apache/spark/sql/e

[GitHub] [spark] maropu commented on a change in pull request #25344: [SPARK-28151][SQL] Mapped ByteType to TinyINT for MsSQLServerDialect

2019-10-30 Thread GitBox
maropu commented on a change in pull request #25344: [SPARK-28151][SQL] Mapped ByteType to TinyINT for MsSQLServerDialect URL: https://github.com/apache/spark/pull/25344#discussion_r340913676 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/Jdbc

[GitHub] [spark] maropu commented on a change in pull request #25344: [SPARK-28151][SQL] Mapped ByteType to TinyINT for MsSQLServerDialect

2019-10-30 Thread GitBox
maropu commented on a change in pull request #25344: [SPARK-28151][SQL] Mapped ByteType to TinyINT for MsSQLServerDialect URL: https://github.com/apache/spark/pull/25344#discussion_r340913676 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/Jdbc

[GitHub] [spark] srowen commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
srowen commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548163117 I don't know of a reason it would change Ganglia support. `metrics-ganglia` is still included, updated, and built here.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548162077 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] SparkQA removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548160428 **[Test build #112974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112974/t

[GitHub] [spark] AmplabJenkins removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548162070 Merged build finished. Test FAILed. Thi

[GitHub] [spark] AmplabJenkins commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548162077 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548162070 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
SparkQA commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548162055 **[Test build #112974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112974/testRepo

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340911928 ## File path: python/pyspark/sql/readwriter.py ## @@ -733,7 +733,7 @@ def save(self, p

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340911742 ## File path: python/pyspark/sql/readwriter.py ## @@ -733,7 +733,7 @@ def save(self, p

[GitHub] [spark] dongjoon-hyun commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
dongjoon-hyun commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548161035 BTW, what happens to `ganglia`? Do we still have `Ganglia` support after this PR? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548160715 Merged build finished. Test PASSed. Thi

[GitHub] [spark] AmplabJenkins removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548160721 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548160715 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548160721 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] dongjoon-hyun commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
dongjoon-hyun commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548160789 Wow. Nice! This is an automated message from th

[GitHub] [spark] SparkQA commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
SparkQA commented on issue #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#issuecomment-548160428 **[Test build #112974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112974/testRepor

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548159873 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548159868 Merged build finished. Test FAILed. This is an a

[GitHub] [spark] SparkQA removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548155118 **[Test build #112973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112973/testReport

[GitHub] [spark] AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548159868 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] srowen commented on a change in pull request #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
srowen commented on a change in pull request #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332#discussion_r340909782 ## File path: core/pom.xml ## @@ -292,6 +292,16 @@ io.dropwizard.metric

[GitHub] [spark] AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548159873 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] shivsood commented on a change in pull request #26301: [SPARK-29644] [SQL] Corrected ShortType wrongly set as Int in JDBCUtils.scala.

2019-10-30 Thread GitBox
shivsood commented on a change in pull request #26301: [SPARK-29644] [SQL] Corrected ShortType wrongly set as Int in JDBCUtils.scala. URL: https://github.com/apache/spark/pull/26301#discussion_r340909981 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spa

[GitHub] [spark] srowen opened a new pull request #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+

2019-10-30 Thread GitBox
srowen opened a new pull request #26332: [SPARK-29674][CORE] Update dropwizard metrics to 4.1.x for JDK 9+ URL: https://github.com/apache/spark/pull/26332 ### What changes were proposed in this pull request? Update the version of dropwizard metrics that Spark uses for metrics to 4.1

[GitHub] [spark] SparkQA commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
SparkQA commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548159711 **[Test build #112973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112973/testReport)** fo

<    1   2   3   4   5   6   7   8   9   10   >