[GitHub] LantaoJin commented on a change in pull request #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2019-01-07 Thread GitBox
LantaoJin commented on a change in pull request #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#discussion_r245867274 ## File path: core/src/main/scala/org/apache/spark/metrics/ExecutorMetricType.scala ## @

[GitHub] AmplabJenkins removed a comment on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter URL: https://github.com/apache/spark/pull/23462#issuecomment-452200388 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] AmplabJenkins removed a comment on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter URL: https://github.com/apache/spark/pull/23462#issuecomment-452200385 Merged build finished. Test PASSed. This

[GitHub] SparkQA commented on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter

2019-01-07 Thread GitBox
SparkQA commented on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter URL: https://github.com/apache/spark/pull/23462#issuecomment-452200447 **[Test build #100919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100919/testReport

[GitHub] AmplabJenkins commented on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter URL: https://github.com/apache/spark/pull/23462#issuecomment-452200388 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] AmplabJenkins commented on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter URL: https://github.com/apache/spark/pull/23462#issuecomment-452200385 Merged build finished. Test PASSed. This is an a

[GitHub] viirya commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
viirya commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452200077 @ueshin Ideally we should provide a config to turn off this check. But I'm wondering if there is

[GitHub] MaxGekk commented on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter

2019-01-07 Thread GitBox
MaxGekk commented on issue #23462: [SPARK-26546][SQL] Caching of java.time.format.DateTimeFormatter URL: https://github.com/apache/spark/pull/23462#issuecomment-452199786 jenkins, retest this, please This is an automated mess

[GitHub] MaxGekk commented on issue #23411: [SPARK-26503][CORE] Get rid of spark.sql.legacy.timeParser.enabled

2019-01-07 Thread GitBox
MaxGekk commented on issue #23411: [SPARK-26503][CORE] Get rid of spark.sql.legacy.timeParser.enabled URL: https://github.com/apache/spark/pull/23411#issuecomment-452199451 > Is that what you're interested in testing? Yes, thank you. > If so are we back to favoring removing th

[GitHub] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-452197625 Test FAILed. Refer to this link for build results (access rights to

[GitHub] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-452197622 Merged build finished. Test FAILed. --

[GitHub] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-452197622 Merged build finished. Test FAILed. --

[GitHub] LantaoJin commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2019-01-07 Thread GitBox
LantaoJin commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#issuecomment-452197644 @squito Replaced with a small one: > 285K Jan 8 12:42 core/src/test/resources/spark-events/application_1536831636016

[GitHub] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-452197625 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-01-07 Thread GitBox
SparkQA removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-452160908 **[Test build #100915 has started](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-01-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-452197407 **[Test build #100915 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] ueshin commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
ueshin commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452193929 So since pyarrow 0.11, we won't allow nullable integral types by default? `ScalarPandasUDFTest

[GitHub] HyukjinKwon commented on issue #23488: [SPARK-26564] Fix misleading error message about spark.network.timeout and spark.executor.heartbeatInterval

2019-01-07 Thread GitBox
HyukjinKwon commented on issue #23488: [SPARK-26564] Fix misleading error message about spark.network.timeout and spark.executor.heartbeatInterval URL: https://github.com/apache/spark/pull/23488#issuecomment-452185898 It's okay but mind taking a look for similar instances? I think there are

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The worker di

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] HyukjinKwon commented on issue #23487: [SPARK-26563]Fix java `SimpleApp` documentation

2019-01-07 Thread GitBox
HyukjinKwon commented on issue #23487: [SPARK-26563]Fix java `SimpleApp` documentation URL: https://github.com/apache/spark/pull/23487#issuecomment-452185288 Master is specified in the submit in the example. `then use the spark-submit script to run our program.` ```bash # Use spa

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter edited a comment on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is

[GitHub] httfighter commented on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter commented on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452184077 @srowen The main process leading to this problem is analyzed below. 1、The wordir is create

[GitHub] HyukjinKwon commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange

2019-01-07 Thread GitBox
HyukjinKwon commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange URL: https://github.com/apache/spark/pull/23470#issuecomment-452183761 Also, let's fix PR description and title from xrange to range as generator. Range in Python

[GitHub] httfighter commented on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_…

2019-01-07 Thread GitBox
httfighter commented on issue #23437: [SPARK-26524] If the application directory fails to be created on the SPARK_WORKER_… URL: https://github.com/apache/spark/pull/23437#issuecomment-452183521 @srowen Thank you for your review. I am adding new config and state to track if the Worker node

[GitHub] AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452183401 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452183401 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452183399 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452183399 Merged build finished. Test PASSed. -

[GitHub] SparkQA removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
SparkQA removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452178488 **[Test build #100918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] SparkQA commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
SparkQA commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452183236 **[Test build #100918 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] AmplabJenkins removed a comment on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490#issuecomment-452182378 Can one of the admins verify this patch? -

[GitHub] AmplabJenkins removed a comment on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490#issuecomment-452182912 Can one of the admins verify this patch? -

[GitHub] AmplabJenkins commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490#issuecomment-452182975 Can one of the admins verify this patch? -

[GitHub] AmplabJenkins commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490#issuecomment-452182912 Can one of the admins verify this patch? -

[GitHub] southernriver commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread GitBox
southernriver commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490#issuecomment-452182686 @cloud-fan @carsonwang Could you please have a look at this?

[GitHub] AmplabJenkins commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490#issuecomment-452182378 Can one of the admins verify this patch? -

[GitHub] southernriver opened a new pull request #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread GitBox
southernriver opened a new pull request #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490 ## What changes were proposed in this pull request? For SparkSQL ,when we open AE by 'set sp

[GitHub] srowen commented on issue #20512: [SPARK-23182][CORE] Allow enabling TCP keep alive on the master RPC connections.

2019-01-07 Thread GitBox
srowen commented on issue #20512: [SPARK-23182][CORE] Allow enabling TCP keep alive on the master RPC connections. URL: https://github.com/apache/spark/pull/20512#issuecomment-452181557 I see, @peshopetrov , could you maybe narrow the scope of the change to only affect master RPCs? that se

[GitHub] southernriver closed pull request #23478: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-07 Thread GitBox
southernriver closed pull request #23478: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23478 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is display

[GitHub] coderplay edited a comment on issue #20512: [SPARK-23182][CORE] Allow enabling TCP keep alive on the master RPC connections.

2019-01-07 Thread GitBox
coderplay edited a comment on issue #20512: [SPARK-23182][CORE] Allow enabling TCP keep alive on the master RPC connections. URL: https://github.com/apache/spark/pull/20512#issuecomment-452178010 Clarification: I am not a spark expert, just got an invitation from @rxin because he think I

[GitHub] AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452178556 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452178558 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452178558 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-45213 Test FAILed. Refer to this link for build results (access rights to CI server n

[GitHub] AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452178556 Merged build finished. Test PASSed. -

[GitHub] SparkQA commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
SparkQA commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452178488 **[Test build #100918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] coderplay commented on issue #20512: [SPARK-23182][CORE] Allow enabling TCP keep alive on the master RPC connections.

2019-01-07 Thread GitBox
coderplay commented on issue #20512: [SPARK-23182][CORE] Allow enabling TCP keep alive on the master RPC connections. URL: https://github.com/apache/spark/pull/20512#issuecomment-452178010 Clarification: I am not a spark expert, just got an invitation from @rxin because he think I have s

[GitHub] AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-45211 Merged build finished. Test FAILed. -

[GitHub] AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-45213 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HyukjinKwon commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange

2019-01-07 Thread GitBox
HyukjinKwon commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange URL: https://github.com/apache/spark/pull/23470#issuecomment-452177786 LGTM too considering it's a quick bandaid fix.

[GitHub] AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-45211 Merged build finished. Test FAILed. -

[GitHub] viirya commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
viirya commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452177528 > Were you thinking of putting in a spark config to toggle the safe flag here or in a follow up?

[GitHub] HyukjinKwon commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange

2019-01-07 Thread GitBox
HyukjinKwon commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange URL: https://github.com/apache/spark/pull/23470#issuecomment-452177584 re: https://github.com/apache/spark/pull/23470#issuecomment-452173964 Yea, I think so

[GitHub] AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452177099 Test FAILed. Refer to this link for build results (access rights to CI server n

[GitHub] SparkQA removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
SparkQA removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452176923 **[Test build #100917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] HyukjinKwon commented on a change in pull request #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange

2019-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange URL: https://github.com/apache/spark/pull/23470#discussion_r245878687 ## File path: python/pyspark/tests/test_worker.py ## @@

[GitHub] AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452177096 Merged build finished. Test FAILed. -

[GitHub] AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452177099 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
SparkQA commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452177092 **[Test build #100917 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] viirya commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
viirya commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452177047 Sorry for not pushing this for a while. Hope we can make it soon. --

[GitHub] AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452177096 Merged build finished. Test FAILed. -

[GitHub] viirya commented on a change in pull request #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
viirya commented on a change in pull request #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#discussion_r245878431 ## File path: python/pyspark/sql/tests.py ## @@ -4961,6 +496

[GitHub] HyukjinKwon commented on a change in pull request #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange

2019-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange URL: https://github.com/apache/spark/pull/23470#discussion_r245878479 ## File path: python/pyspark/tests/test_worker.py ## @@

[GitHub] SparkQA commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
SparkQA commented on issue #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-452176923 **[Test build #100917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] viirya commented on a change in pull request #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-07 Thread GitBox
viirya commented on a change in pull request #22807: [WIP][SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#discussion_r245878286 ## File path: python/pyspark/serializers.py ## @@ -284,7 +28

[GitHub] HyukjinKwon commented on a change in pull request #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange

2019-01-07 Thread GitBox
HyukjinKwon commented on a change in pull request #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange URL: https://github.com/apache/spark/pull/23470#discussion_r245877915 ## File path: python/pyspark/context.py ## @@ -493,6 +4

[GitHub] BryanCutler commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange

2019-01-07 Thread GitBox
BryanCutler commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange URL: https://github.com/apache/spark/pull/23470#issuecomment-452173964 Does this mean that the user could also map a function that doesn't consume the iterator an

[GitHub] ueshin commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange

2019-01-07 Thread GitBox
ueshin commented on issue #23470: [SPARK-26549][PySpark] Fix for python worker reuse take no effect for parallelize xrange URL: https://github.com/apache/spark/pull/23470#issuecomment-452172770 LGTM, too. This is an automated

[GitHub] linehrr edited a comment on issue #23324: [SPARK-26267][SS]Retry when detecting incorrect offsets from Kafka

2019-01-07 Thread GitBox
linehrr edited a comment on issue #23324: [SPARK-26267][SS]Retry when detecting incorrect offsets from Kafka URL: https://github.com/apache/spark/pull/23324#issuecomment-452172192 @zsxwing not too sure if this is actually a bug related to this fix, but I can share my stacktrace here:

[GitHub] linehrr commented on issue #23324: [SPARK-26267][SS]Retry when detecting incorrect offsets from Kafka

2019-01-07 Thread GitBox
linehrr commented on issue #23324: [SPARK-26267][SS]Retry when detecting incorrect offsets from Kafka URL: https://github.com/apache/spark/pull/23324#issuecomment-452172192 @zsxwing not too sure if this is actually a bug related to this fix, but I can share my stacktrace here: ```

[GitHub] AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452171811 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452171811 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452171817 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452171817 Test PASSed. Refer to this link for build results (access rights to CI s

[GitHub] SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452171621 **[Test build #100916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] cloud-fan commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
cloud-fan commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452171014 HiveClientSuite is really flaky... ---

[GitHub] cloud-fan commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
cloud-fan commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452171033 retest this please Th

[GitHub] AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452170292 Test FAILed. Refer to this link for build results (access rights to CI s

[GitHub] AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452170289 Merged build finished. Test FAILed. --

[GitHub] AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452170289 Merged build finished. Test FAILed. --

[GitHub] AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452170292 Test FAILed. Refer to this link for build results (access rights to CI server ne

[GitHub] SparkQA removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
SparkQA removed a comment on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452151758 **[Test build #100914 has started](https://amplab.cs.berkeley.edu/jenkins/job/Sp

[GitHub] SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

2019-01-07 Thread GitBox
SparkQA commented on issue #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#issuecomment-452170168 **[Test build #100914 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] zhengruifeng commented on a change in pull request #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML

2019-01-07 Thread GitBox
zhengruifeng commented on a change in pull request #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML URL: https://github.com/apache/spark/pull/23144#discussion_r245871966 ## File path: mllib/src/main/scala/org/apache/spark/ml/param/params.scala ##

[GitHub] AmplabJenkins removed a comment on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently.

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently. URL: https://github.com/apache/spark/pull/23302#issuecomment-452167401 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] AmplabJenkins commented on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently.

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently. URL: https://github.com/apache/spark/pull/23302#issuecomment-452167399 Merged build finished. Test PASSed. T

[GitHub] AmplabJenkins commented on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently.

2019-01-07 Thread GitBox
AmplabJenkins commented on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently. URL: https://github.com/apache/spark/pull/23302#issuecomment-452167401 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] AmplabJenkins removed a comment on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently.

2019-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently. URL: https://github.com/apache/spark/pull/23302#issuecomment-452167399 Merged build finished. Test PASSed. --

[GitHub] SparkQA commented on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently.

2019-01-07 Thread GitBox
SparkQA commented on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently. URL: https://github.com/apache/spark/pull/23302#issuecomment-452166995 **[Test build #100911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10091

  1   2   3   4   5   6   7   8   9   10   >