[GitHub] spark pull request #21667: [SPARK-24691][SQL]Add new API `supportDataType` i...

2018-07-03 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21667#discussion_r199694805 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala --- @@ -42,63 +38,27 @@ object DataSourceUtils {

[GitHub] spark pull request #21667: [SPARK-24691][SQL]Add new API `supportDataType` i...

2018-07-03 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21667#discussion_r199695118 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormat.scala --- @@ -152,6 +152,16 @@ trait FileFormat { }

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21633 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread Fokko
Github user Fokko commented on the issue: https://github.com/apache/spark/pull/21596 I can do a 5 runs before and after the patch, and come up with some statistics such as average and stddev, to get rid of the uncertainty a bit. ---

[GitHub] spark pull request #21667: [SPARK-24691][SQL]Add new API `supportDataType` i...

2018-07-03 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21667#discussion_r199695311 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormat.scala --- @@ -152,6 +152,16 @@ trait FileFormat { }

[GitHub] spark pull request #21671: [SPARK-24682] [SQL] from_json / to_json now handl...

2018-07-03 Thread patrickmcgloin
Github user patrickmcgloin commented on a diff in the pull request: https://github.com/apache/spark/pull/21671#discussion_r199696129 --- Diff: python/pyspark/sql/functions.py --- @@ -2163,9 +2163,9 @@ def json_tuple(col, *fields): @since(2.1) def from_json(col, schema,

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21633 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92552/ Test FAILed. ---

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21633 **[Test build #92552 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92552/testReport)** for PR 21633 at commit

[GitHub] spark pull request #20838: [SPARK-23698] Resolve undefined names in Python 3

2018-07-03 Thread cclauss
Github user cclauss commented on a diff in the pull request: https://github.com/apache/spark/pull/20838#discussion_r199701953 --- Diff: python/pyspark/sql/conf.py --- @@ -59,7 +62,7 @@ def unset(self, key): def _checkType(self, obj, identifier):

[GitHub] spark pull request #20838: [SPARK-23698] Resolve undefined names in Python 3

2018-07-03 Thread cclauss
Github user cclauss commented on a diff in the pull request: https://github.com/apache/spark/pull/20838#discussion_r199702001 --- Diff: dev/create-release/releaseutils.py --- @@ -49,6 +49,9 @@ print("Install using 'sudo pip install unidecode'") sys.exit(-1)

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21596 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92554/ Test FAILed. ---

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21596 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21596 **[Test build #92554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92554/testReport)** for PR 21596 at commit

[GitHub] spark issue #21701: [SPARK-24730][SS] Add policy to choose max as global wat...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21701 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92553/ Test FAILed. ---

[GitHub] spark issue #21701: [SPARK-24730][SS] Add policy to choose max as global wat...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21701 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20838: [SPARK-23698] Resolve undefined names in Python 3

2018-07-03 Thread cclauss
Github user cclauss commented on a diff in the pull request: https://github.com/apache/spark/pull/20838#discussion_r199701965 --- Diff: dev/merge_spark_pr.py --- @@ -39,6 +39,9 @@ except ImportError: JIRA_IMPORTED = False +if sys.version_info[0] >= 3: +

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/21633 Jenkins, retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21633 **[Test build #92555 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92555/testReport)** for PR 21633 at commit

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21633 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21702: [SPARK-23698] Remove raw_input() from Python 2

2018-07-03 Thread cclauss
GitHub user cclauss opened a pull request: https://github.com/apache/spark/pull/21702 [SPARK-23698] Remove raw_input() from Python 2 Signed-off-by: cclauss ## What changes were proposed in this pull request? Humans will be able to enter text in Python 3 prompts

[GitHub] spark pull request #21667: [SPARK-24691][SQL]Add new API `supportDataType` i...

2018-07-03 Thread gengliangwang
Github user gengliangwang commented on a diff in the pull request: https://github.com/apache/spark/pull/21667#discussion_r199705148 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala --- @@ -42,63 +38,27 @@ object DataSourceUtils {

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21633 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/632/

[GitHub] spark issue #21702: [SPARK-23698] Remove raw_input() from Python 2

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21702 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21702: [SPARK-23698] Remove raw_input() from Python 2

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21702 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21678: [SPARK-23461][R]vignettes should include model predictio...

2018-07-03 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/21678 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21596 **[Test build #92558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92558/testReport)** for PR 21596 at commit

[GitHub] spark issue #21703: [SPARK-24732][SQL] Type coercion between MapTypes.

2018-07-03 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21703 cc @gatorsmile @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21703: [SPARK-24732][SQL] Type coercion between MapTypes.

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21703 **[Test build #92559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92559/testReport)** for PR 21703 at commit

[GitHub] spark issue #21703: [SPARK-24732][SQL] Type coercion between MapTypes.

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21703 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/635/

[GitHub] spark issue #21703: [SPARK-24732][SQL] Type coercion between MapTypes.

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21703 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21073: [SPARK-23936][SQL] Implement map_concat

2018-07-03 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/21073#discussion_r199722217 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -551,6 +551,36 @@ object TypeCoercion {

[GitHub] spark pull request #21702: [SPARK-23698] Remove raw_input() from Python 2

2018-07-03 Thread cclauss
Github user cclauss commented on a diff in the pull request: https://github.com/apache/spark/pull/21702#discussion_r199723478 --- Diff: dev/create-release/releaseutils.py --- @@ -49,13 +49,16 @@ print("Install using 'sudo pip install unidecode'") sys.exit(-1)

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21666 **[Test build #92556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92556/testReport)** for PR 21666 at commit

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21666 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92556/ Test PASSed. ---

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92557/ Test PASSed. ---

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21666 **[Test build #92557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92557/testReport)** for PR 21666 at commit

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21666 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21703: [SPARK-24732][SQL] Type coercion between MapTypes.

2018-07-03 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21703 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21701: [SPARK-24730][SS] Add policy to choose max as global wat...

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21701 **[Test build #92553 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92553/testReport)** for PR 21701 at commit

[GitHub] spark issue #21702: [SPARK-23698] Remove raw_input() from Python 2

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21702 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21649: [SPARK-23648][R][SQL]Adds more types for hint in ...

2018-07-03 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21649#discussion_r199706822 --- Diff: R/pkg/R/DataFrame.R --- @@ -3905,6 +3905,16 @@ setMethod("rollup", groupedData(sgd) })

[GitHub] spark issue #21678: [SPARK-23461][R]vignettes should include model predictio...

2018-07-03 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/21678 ok then, thanks --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21666: [SPARK-24535][SPARKR] fix tests on java check err...

2018-07-03 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/21666#discussion_r199713355 --- Diff: R/pkg/R/client.R --- @@ -61,6 +61,11 @@ generateSparkSubmitArgs <- function(args, sparkHome, jars, sparkSubmitOpts, pack }

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/633/

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21666 **[Test build #92556 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92556/testReport)** for PR 21666 at commit

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21666 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21666 **[Test build #92557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92557/testReport)** for PR 21666 at commit

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/634/

[GitHub] spark issue #21666: [SPARK-24535][SPARKR] fix tests on java check error

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21666 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21702: [SPARK-23698] Remove raw_input() from Python 2

2018-07-03 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21702#discussion_r199718062 --- Diff: dev/create-release/releaseutils.py --- @@ -49,13 +49,16 @@ print("Install using 'sudo pip install unidecode'") sys.exit(-1)

[GitHub] spark pull request #21703: [SPARK-24732][SQL] Type coercion between MapTypes...

2018-07-03 Thread ueshin
GitHub user ueshin opened a pull request: https://github.com/apache/spark/pull/21703 [SPARK-24732][SQL] Type coercion between MapTypes. ## What changes were proposed in this pull request? Currently we don't allow type coercion between maps. We can support type coercion

[GitHub] spark pull request #21699: [SPARK-24722][SQL] pivot() with Column type argum...

2018-07-03 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21699#discussion_r199742580 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala --- @@ -340,36 +340,52 @@ class RelationalGroupedDataset

[GitHub] spark issue #21699: [SPARK-24722][SQL] pivot() with Column type argument

2018-07-03 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21699 `def pivot(pivotColumn: String)`, too? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21699: [SPARK-24722][SQL] pivot() with Column type argument

2018-07-03 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21699 cc: @rxin @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21693: [SPARK-24673][SQL] scala sql function from_utc_ti...

2018-07-03 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21693#discussion_r199744502 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -2945,6 +2956,17 @@ object functions { ToUTCTimestamp(ts.expr,

[GitHub] spark issue #21693: [SPARK-24673][SQL] scala sql function from_utc_timestamp...

2018-07-03 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21693 cc: @ueshin @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #21693: [SPARK-24673][SQL] scala sql function from_utc_ti...

2018-07-03 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21693#discussion_r199744569 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -2934,6 +2934,17 @@ object functions { FromUTCTimestamp(ts.expr,

[GitHub] spark issue #21260: [SPARK-23529][K8s] Support mounting volumes

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21260 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21699: [SPARK-24722][SQL] pivot() with Column type argument

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21699 **[Test build #92561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92561/testReport)** for PR 21699 at commit

[GitHub] spark issue #21704: [SPARK-24734][SQL] Fix containsNull of Concat for array ...

2018-07-03 Thread mn-mikke
Github user mn-mikke commented on the issue: https://github.com/apache/spark/pull/21704 @ueshin Thanks for bringing this topic! This problem with different ```nullable```/```containsNull``` flags seems to be more generic. In [21687](https://github.com/apache/spark/pull/21687), we've

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/21633 Jenkins, retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21633 **[Test build #92563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92563/testReport)** for PR 21633 at commit

[GitHub] spark issue #21260: [SPARK-23529][K8s] Support mounting volumes

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21260 **[Test build #92560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92560/testReport)** for PR 21260 at commit

[GitHub] spark issue #21260: [SPARK-23529][K8s] Support mounting volumes

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21260 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92560/ Test PASSed. ---

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21633 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92555/ Test FAILed. ---

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21633 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21704: [SPARK-24734][SQL] Fix containsNull of Concat for array ...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/636/

[GitHub] spark issue #21704: [SPARK-24734][SQL] Fix containsNull of Concat for array ...

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21704 **[Test build #92562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92562/testReport)** for PR 21704 at commit

[GitHub] spark issue #21704: [SPARK-24734][SQL] Fix containsNull of Concat for array ...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21704 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21596 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92558/ Test PASSed. ---

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21596 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21596 **[Test build #92558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92558/testReport)** for PR 21596 at commit

[GitHub] spark issue #21702: [SPARK-23698] Remove raw_input() from Python 2

2018-07-03 Thread cclauss
Github user cclauss commented on the issue: https://github.com/apache/spark/pull/21702 Tested data entry... In __./dev/merge_spark_pr.py__ just after __clean_up()__, I added the lines: ``` while not continue_maybe('y to conntinue'): print('loop') sys.exit()

[GitHub] spark issue #21596: [SPARK-24601] Bump Jackson version

2018-07-03 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21596 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21260: [SPARK-23529][K8s] Support mounting volumes

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21260 **[Test build #92560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92560/testReport)** for PR 21260 at commit

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21633 **[Test build #92555 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92555/testReport)** for PR 21633 at commit

[GitHub] spark issue #21704: [SPARK-24734][SQL] Fix containsNull of Concat for array ...

2018-07-03 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21704 cc @mn-mikke @gatorsmile @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21703: [SPARK-24732][SQL] Type coercion between MapTypes.

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21703 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92559/ Test PASSed. ---

[GitHub] spark issue #21703: [SPARK-24732][SQL] Type coercion between MapTypes.

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21703 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21703: [SPARK-24732][SQL] Type coercion between MapTypes.

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21703 **[Test build #92559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92559/testReport)** for PR 21703 at commit

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21633 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/637/

[GitHub] spark issue #21633: [SPARK-24646][CORE] Minor change to spark.yarn.dist.forc...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21633 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21704: [SPARK-24734][SQL] Fix containsNull of Concat for array ...

2018-07-03 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/21704 @mn-mikke Thanks! I'll take a look and join the discussion later. --- - To unsubscribe, e-mail:

[GitHub] spark pull request #21704: [SPARK-24734][SQL] Fix containsNull of Concat for...

2018-07-03 Thread ueshin
GitHub user ueshin opened a pull request: https://github.com/apache/spark/pull/21704 [SPARK-24734][SQL] Fix containsNull of Concat for array type. ## What changes were proposed in this pull request? Currently `Concat` for array type uses the data type of the first child as

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2018-07-03 Thread ifilonenko
Github user ifilonenko commented on the issue: https://github.com/apache/spark/pull/13599 Is there any work being done on this PR at this point in time? --- - To unsubscribe, e-mail:

[GitHub] spark issue #21699: [SPARK-24722][SQL] pivot() with Column type argument

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21699 **[Test build #92577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92577/testReport)** for PR 21699 at commit

[GitHub] spark pull request #21705: [SPARK-24727][SQL] Add a static config to control...

2018-07-03 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/21705#discussion_r199940775 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala --- @@ -66,6 +66,12 @@ object StaticSQLConf {

[GitHub] spark pull request #21689: [Minor][ML]Minor correction in the powerIteration...

2018-07-03 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/21689#discussion_r199950647 --- Diff: mllib/src/test/scala/org/apache/spark/ml/clustering/PowerIterationClusteringSuite.scala --- @@ -76,23 +78,25 @@ class

[GitHub] spark pull request #21689: [Minor][ML]Minor correction in the powerIteration...

2018-07-03 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/21689#discussion_r199950628 --- Diff: mllib/src/test/scala/org/apache/spark/ml/clustering/PowerIterationClusteringSuite.scala --- @@ -76,23 +78,25 @@ class

[GitHub] spark issue #21588: [SPARK-24590][BUILD] Make Jenkins tests passed with hado...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21588 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92573/ Test PASSed. ---

[GitHub] spark issue #21708: [BUILD] Close stale PRs

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21708 **[Test build #92579 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92579/testReport)** for PR 21708 at commit

[GitHub] spark issue #21067: [SPARK-23980][K8S] Resilient Spark driver on Kubernetes

2018-07-03 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/21067 @baluchicken @foxish any update on this? HA story is pretty critical for production in many cases. --- - To unsubscribe,

[GitHub] spark issue #21705: [SPARK-24727][SQL] Add a static config to control cache ...

2018-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21705 **[Test build #92586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92586/testReport)** for PR 21705 at commit

[GitHub] spark issue #21659: [SPARK-24530][PYTHON] Add a control to force Python vers...

2018-07-03 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21659 Ah, I mean PRs in spark-website to fix the API documentation. --- - To unsubscribe, e-mail:

[GitHub] spark issue #21686: [SPARK-24709][SQL] schema_of_json() - schema inference f...

2018-07-03 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21686 Merged to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21700: [SPARK-24717][SS] Split out max retain version of state ...

2018-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21700 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21507: Branch 1.6

2018-07-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21507 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20809: [SPARK-23667][CORE] Better scala version check

2018-07-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20809 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20932: [SPARK-23812][SQL] DFS should be removed from uns...

2018-07-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20932 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

  1   2   3   4   5   >