[GitHub] [spark] nishchalv opened a new pull request #26331: [SPARK-29670][core] Make executor's bindAddress configurable

2019-10-30 Thread GitBox
nishchalv opened a new pull request #26331: [SPARK-29670][core] Make executor's bindAddress configurable URL: https://github.com/apache/spark/pull/26331 ### What changes were proposed in this pull request? With this change, executor's bindAddress is passed as an input parameter for RPCE

[GitHub] [spark] shaneknapp opened a new pull request #26330: [WIP][SPARK-29672][PYSPARK] remove py27 support for jenkins tests

2019-10-30 Thread GitBox
shaneknapp opened a new pull request #26330: [WIP][SPARK-29672][PYSPARK] remove py27 support for jenkins tests URL: https://github.com/apache/spark/pull/26330 ### What changes were proposed in this pull request? remove python2.7 tests for 3.0+ ### Why are the changes needed?

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548106101 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548106092 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548106101 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548106092 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
SparkQA commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548105447 **[Test build #112964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112964/testReport)** for

[GitHub] [spark] LucaCanali commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver.

2019-10-30 Thread GitBox
LucaCanali commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver. URL: https://github.com/apache/spark/pull/26170#discussion_r340848727 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @

[GitHub] [spark] MaxGekk commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
MaxGekk commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548102964 The build https://github.com/apache/spark/pull/26327#issuecomment-548087401 fails on: `'1 2:03' day to hour` because

[GitHub] [spark] AmplabJenkins removed a comment on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode URL: https://github.com/apache/spark/pull/26329#issuecomment-548102873 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode URL: https://github.com/apache/spark/pull/26329#issuecomment-548102884 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] huaxingao commented on a change in pull request #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth

2019-10-30 Thread GitBox
huaxingao commented on a change in pull request #26322: [SPARK-29656][ML][PYSPARK] ML algs expose aggregationDepth URL: https://github.com/apache/spark/pull/26322#discussion_r340847003 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/RobustScaler.scala ## @@

[GitHub] [spark] AmplabJenkins commented on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode URL: https://github.com/apache/spark/pull/26329#issuecomment-548102884 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548099832 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode URL: https://github.com/apache/spark/pull/26329#issuecomment-548102873 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548099840 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] SparkQA commented on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode

2019-10-30 Thread GitBox
SparkQA commented on issue #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode URL: https://github.com/apache/spark/pull/26329#issuecomment-548102312 **[Test build #112962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112962/tes

[GitHub] [spark] SparkQA commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
SparkQA commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548102339 **[Test build #112963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112963/testReport)** for

[GitHub] [spark] dongjoon-hyun commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548101842 Could you run `dev/lint-python` and fix the errors? ``` pycodestyle checks failed: 80 ./python/pyspark/sql/ses

[GitHub] [spark] jiangxb1987 opened a new pull request #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode

2019-10-30 Thread GitBox
jiangxb1987 opened a new pull request #26329: [SPARK-29666][BUILD] Fix the publish release failure under dry-run mode URL: https://github.com/apache/spark/pull/26329 ### What changes were proposed in this pull request? `release-build.sh` fail to publish release under dry run mode wit

[GitHub] [spark] vanzin commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver.

2019-10-30 Thread GitBox
vanzin commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver. URL: https://github.com/apache/spark/pull/26170#discussion_r340843930 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@ -1

[GitHub] [spark] AmplabJenkins removed a comment on issue #26324: [SPARK-29462] The data type of "array()" should be array

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26324: [SPARK-29462] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/26324#issuecomment-548100331 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #26324: [SPARK-29462] The data type of "array()" should be array

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26324: [SPARK-29462] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/26324#issuecomment-548100324 Merged build finished. Test FAILed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #26324: [SPARK-29462] The data type of "array()" should be array

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26324: [SPARK-29462] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/26324#issuecomment-548100324 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26324: [SPARK-29462] The data type of "array()" should be array

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26324: [SPARK-29462] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/26324#issuecomment-548100331 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099921 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] SparkQA removed a comment on issue #26324: [SPARK-29462] The data type of "array()" should be array

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26324: [SPARK-29462] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/26324#issuecomment-548027775 **[Test build #112946 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112946/testReport

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099592 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099932 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099932 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] SparkQA commented on issue #26324: [SPARK-29462] The data type of "array()" should be array

2019-10-30 Thread GitBox
SparkQA commented on issue #26324: [SPARK-29462] The data type of "array()" should be array URL: https://github.com/apache/spark/pull/26324#issuecomment-548100060 **[Test build #112946 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112946/testReport)** fo

[GitHub] [spark] AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099921 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099184 **[Test build #112961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112961/testReport

[GitHub] [spark] AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099592 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548099832 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328#issuecomment-548099840 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099565 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099565 Merged build finished. Test FAILed. This is an a

[GitHub] [spark] SparkQA commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
SparkQA commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099514 **[Test build #112961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112961/testReport)** fo

[GitHub] [spark] jiangxb1987 commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
jiangxb1987 commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548099349 > is 3.0.0.dev0 the more 'conventional' version number for a preview-like releas

[GitHub] [spark] SparkQA commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
SparkQA commented on issue #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548099184 **[Test build #112961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112961/testReport)** for

[GitHub] [spark] maryannxue opened a new pull request #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning

2019-10-30 Thread GitBox
maryannxue opened a new pull request #26328: [SPARK-11150][SQL][FOLLOW-UP] Dynamic partition pruning URL: https://github.com/apache/spark/pull/26328 ### What changes were proposed in this pull request? This is code cleanup PR for https://github.com/apache/spark/pull/25600, aiming to rem

[GitHub] [spark] AmplabJenkins removed a comment on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548097803 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548097808 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548097803 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548097808 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] SparkQA removed a comment on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548031673 **[Test build #112948 has started](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] [spark] SparkQA commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
SparkQA commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548097027 **[Test build #112948 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] srowen commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
srowen commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340838479 ## File path: python/pyspark/sql/session.py ## @@ -151,7 +151,7 @@ def getOrCreate(self):

[GitHub] [spark] srowen commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
srowen commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548096156 Dumb question: is 3.0.0.dev0 the more 'conventional' version number for a preview-lik

[GitHub] [spark] AmplabJenkins removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548094997 Test FAILed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] srowen commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
srowen commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340838313 ## File path: python/pyspark/sql/session.py ## @@ -136,7 +136,7 @@ def appName(self, name):

[GitHub] [spark] AmplabJenkins commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548094991 Merged build finished. Test FAILed. Th

[GitHub] [spark] AmplabJenkins commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548094997 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548094991 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548047858 **[Test build #112954 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process

2019-10-30 Thread GitBox
SparkQA commented on issue #26282: [SPARK-29619] Add meaningful log and retry for start python worker process URL: https://github.com/apache/spark/pull/26282#issuecomment-548094714 **[Test build #112954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112954

[GitHub] [spark] jiangxb1987 commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

2019-10-30 Thread GitBox
jiangxb1987 commented on issue #26306: [SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script URL: https://github.com/apache/spark/pull/26306#issuecomment-548094347 @dongjoon-hyun As we previously discussed (https://github.com/apache/spark/pull/

[GitHub] [spark] mstill3 commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
mstill3 commented on a change in pull request #26299: [MINOR][PYSPARK][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340837049 ## File path: python/pyspark/sql/streaming.py ## @@ -1062,7 +1062,7 @@ def foreachBatch(self

[GitHub] [spark] LucaCanali commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver.

2019-10-30 Thread GitBox
LucaCanali commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver. URL: https://github.com/apache/spark/pull/26170#discussion_r340832119 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @

[GitHub] [spark] dongjoon-hyun commented on issue #26299: [PYSPARK][DOCS][MINOR] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on issue #26299: [PYSPARK][DOCS][MINOR] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548089624 Thank you for your first contribution, @mstill3 . I left a few minor comments. BTW, please don't change the title. Th

[GitHub] [spark] MaxGekk commented on issue #26313: [SPARK-29651][SQL] Fix parsing of interval seconds fraction

2019-10-30 Thread GitBox
MaxGekk commented on issue #26313: [SPARK-29651][SQL] Fix parsing of interval seconds fraction URL: https://github.com/apache/spark/pull/26313#issuecomment-548089199 > Yes. +1 for @cloud-fan 's suggestion. Originally, I thought it's natural, but @cloud-fan 's suggestion sounds more practic

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26299: [PYSPARK][DOCS][MINOR] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #26299: [PYSPARK][DOCS][MINOR] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340830867 ## File path: python/pyspark/sql/readwriter.py ## @@ -733,7 +733,7 @@ def save(self, p

[GitHub] [spark] AmplabJenkins removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548087449 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548087444 Merged build finished. Test FAILed. Th

[GitHub] [spark] srowen commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
srowen commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340829978 ## File path: python/pyspark/sql/readwriter.py ## @@ -733,7 +733,7 @@ def save(self, path=None, format

[GitHub] [spark] SparkQA removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548077360 **[Test build #112960 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112960/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340830030 ## File path: python/pyspark/sql/streaming.py ## @@ -1062,7 +1062,7 @@ def foreachBatch(self, f

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340829602 ## File path: python/pyspark/sql/session.py ## @@ -151,7 +151,7 @@ def getOrCreate(self):

[GitHub] [spark] AmplabJenkins commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548087449 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548087444 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
SparkQA commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548087401 **[Test build #112960 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112960/testRep

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340829038 ## File path: python/pyspark/sql/session.py ## @@ -136,7 +136,7 @@ def appName(self, name):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation

2019-10-30 Thread GitBox
dongjoon-hyun commented on a change in pull request #26299: [MINOR][DOCS] Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#discussion_r340828563 ## File path: python/pyspark/sql/readwriter.py ## @@ -733,7 +733,7 @@ def save(self, path=None,

[GitHub] [spark] AmplabJenkins commented on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26304#issuecomment-548082752 Test PASSed. Refer to this link for build results (access rights to CI ser

[GitHub] [spark] AmplabJenkins removed a comment on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26304#issuecomment-548082752 Test PASSed. Refer to this link for build results (access rights t

[GitHub] [spark] AmplabJenkins removed a comment on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26304#issuecomment-548082745 Merged build finished. Test PASSed.

[GitHub] [spark] MaxGekk commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
MaxGekk commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548082941 @dongjoon-hyun @srowen @cloud-fan @HyukjinKwon Could you take a look at this, please. --

[GitHub] [spark] AmplabJenkins commented on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26304#issuecomment-548082745 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26304#issuecomment-547979835 **[Test build #112932 has started](https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] dongjoon-hyun commented on issue #26313: [SPARK-29651][SQL] Fix parsing of interval seconds fraction

2019-10-30 Thread GitBox
dongjoon-hyun commented on issue #26313: [SPARK-29651][SQL] Fix parsing of interval seconds fraction URL: https://github.com/apache/spark/pull/26313#issuecomment-548082233 Yes. +1 for @cloud-fan 's suggestion. Originally, I thought it's natural, but @cloud-fan 's suggestion sounds more pra

[GitHub] [spark] SparkQA commented on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands

2019-10-30 Thread GitBox
SparkQA commented on issue #26304: [SPARK-29592][SQL] ALTER TABLE (set partition location) should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26304#issuecomment-548082087 **[Test build #112932 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] jeff303 commented on a change in pull request #26286: [SPARK-26739][SQL] Standardized Join Types for DataFrames

2019-10-30 Thread GitBox
jeff303 commented on a change in pull request #26286: [SPARK-26739][SQL] Standardized Join Types for DataFrames URL: https://github.com/apache/spark/pull/26286#discussion_r340823270 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -980,21 +980

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548079430 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job

[GitHub] [spark] AmplabJenkins removed a comment on issue #26299: Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26299: Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548079422 Merged build finished. Test FAILed. This is an automated message from t

[GitHub] [spark] AmplabJenkins commented on issue #26299: Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548079430 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPul

[GitHub] [spark] AmplabJenkins commented on issue #26299: Fix typo in example documentation

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26299: Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548079422 Merged build finished. Test FAILed. This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on issue #26299: Fix typo in example documentation

2019-10-30 Thread GitBox
SparkQA commented on issue #26299: Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548079229 **[Test build #112958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112958/testReport)** for PR 26299 at commit [`

[GitHub] [spark] SparkQA removed a comment on issue #26299: Fix typo in example documentation

2019-10-30 Thread GitBox
SparkQA removed a comment on issue #26299: Fix typo in example documentation URL: https://github.com/apache/spark/pull/26299#issuecomment-548071610 **[Test build #112958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112958/testReport)** for PR 26299 at com

[GitHub] [spark] AmplabJenkins removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548077812 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
AmplabJenkins removed a comment on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548077798 Merged build finished. Test PASSed. Th

[GitHub] [spark] AmplabJenkins commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548077798 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
AmplabJenkins commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548077812 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] MaxGekk commented on a change in pull request #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
MaxGekk commented on a change in pull request #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#discussion_r340818636 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.

[GitHub] [spark] MaxGekk commented on a change in pull request #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
MaxGekk commented on a change in pull request #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#discussion_r340818300 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.

[GitHub] [spark] SparkQA commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
SparkQA commented on issue #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327#issuecomment-548077360 **[Test build #112960 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112960/testRepo

[GitHub] [spark] MaxGekk opened a new pull request #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString()

2019-10-30 Thread GitBox
MaxGekk opened a new pull request #26327: [WIP][SPARK-29669][SQL] Refactor IntervalUtils.fromDayTimeString() URL: https://github.com/apache/spark/pull/26327 ### What changes were proposed in this pull request? In the PR, I propose to refactor code related to the `IntervalUtils.fromDayTi

[GitHub] [spark] dongjoon-hyun commented on issue #26326: [SPARK-29668][DOCS] Deprecate Python 3 prior to version 3.6

2019-10-30 Thread GitBox
dongjoon-hyun commented on issue #26326: [SPARK-29668][DOCS] Deprecate Python 3 prior to version 3.6 URL: https://github.com/apache/spark/pull/26326#issuecomment-548076343 Thank you for review and approval, @srowen . Merged to master.

[GitHub] [spark] dongjoon-hyun closed pull request #26326: [SPARK-29668][DOCS] Deprecate Python 3 prior to version 3.6

2019-10-30 Thread GitBox
dongjoon-hyun closed pull request #26326: [SPARK-29668][DOCS] Deprecate Python 3 prior to version 3.6 URL: https://github.com/apache/spark/pull/26326 This is an automated message from the Apache Git Service. To respond to th

[GitHub] [spark] PedroCorreiaLuis commented on a change in pull request #26319: [SPARK-29594][SQL] Create a Dataset from a Sequence of Case class where…

2019-10-30 Thread GitBox
PedroCorreiaLuis commented on a change in pull request #26319: [SPARK-29594][SQL] Create a Dataset from a Sequence of Case class where… URL: https://github.com/apache/spark/pull/26319#discussion_r340817033 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/Scal

<    2   3   4   5   6   7   8   9   10   11   >