[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-512731552 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] gengliangwang commented on issue #25180: [SPARK-28423][SQL] merge Scan and Batch/Stream

2019-07-18 Thread GitBox
gengliangwang commented on issue #25180: [SPARK-28423][SQL] merge Scan and Batch/Stream URL: https://github.com/apache/spark/pull/25180#issuecomment-512731283 retest this please. This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25184: [SPARK-28431]Fix CSV datasource throw com.univocity.parsers.common.TextParsingException with large size message

2019-07-18 Thread GitBox
HyukjinKwon commented on a change in pull request #25184: [SPARK-28431]Fix CSV datasource throw com.univocity.parsers.common.TextParsingException with large size message URL: https://github.com/apache/spark/pull/25184#discussion_r304810588 ## File path:

[GitHub] [spark] chitralverma commented on a change in pull request #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
chitralverma commented on a change in pull request #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#discussion_r304810312 ## File path:

[GitHub] [spark] SparkQA commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
SparkQA commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512729194 **[Test build #107839 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512728554 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512728543 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512728554 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512728543 Merged build finished. Test PASSed.

[GitHub] [spark] WeichenXu123 commented on a change in pull request #25184: [SPARK-28431]Fix CSV datasource throw com.univocity.parsers.common.TextParsingException with large size message

2019-07-18 Thread GitBox
WeichenXu123 commented on a change in pull request #25184: [SPARK-28431]Fix CSV datasource throw com.univocity.parsers.common.TextParsingException with large size message URL: https://github.com/apache/spark/pull/25184#discussion_r304799811 ## File path:

[GitHub] [spark] HeartSaVioR commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

2019-07-18 Thread GitBox
HeartSaVioR commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector URL: https://github.com/apache/spark/pull/25135#issuecomment-512718254 It feels me like `consumer.poll(jt.Duration.ZERO)` just doesn't work. Maybe it's only me, but I'm not

[GitHub] [spark] mgaido91 commented on a change in pull request #21599: [SPARK-26218][SQL] Overflow on arithmetic operations returns incorrect result

2019-07-18 Thread GitBox
mgaido91 commented on a change in pull request #21599: [SPARK-26218][SQL] Overflow on arithmetic operations returns incorrect result URL: https://github.com/apache/spark/pull/21599#discussion_r304790863 ## File path:

[GitHub] [spark] mgaido91 commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-07-18 Thread GitBox
mgaido91 commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#discussion_r304787486 ## File path:

[GitHub] [spark] mgaido91 commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-07-18 Thread GitBox
mgaido91 commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#discussion_r304788438 ## File path:

[GitHub] [spark] mgaido91 commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-07-18 Thread GitBox
mgaido91 commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#discussion_r304788997 ## File path:

[GitHub] [spark] mgaido91 commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-07-18 Thread GitBox
mgaido91 commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#discussion_r304789178 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #24967: [SPARK-28163][SS] Use CaseInsensitiveMap for KafkaOffsetReader

2019-07-18 Thread GitBox
HyukjinKwon commented on issue #24967: [SPARK-28163][SS] Use CaseInsensitiveMap for KafkaOffsetReader URL: https://github.com/apache/spark/pull/24967#issuecomment-512711426 Looks fine. This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512710666 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512710653 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512710653 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24967: [SPARK-28163][SS] Use CaseInsensitiveMap for KafkaOffsetReader

2019-07-18 Thread GitBox
HyukjinKwon commented on a change in pull request #24967: [SPARK-28163][SS] Use CaseInsensitiveMap for KafkaOffsetReader URL: https://github.com/apache/spark/pull/24967#discussion_r304784506 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512710666 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512707916 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512707909 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
SparkQA commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512708643 **[Test build #107838 has

[GitHub] [spark] AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512707909 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512707916 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] chitralverma commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
chitralverma commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512707723 retest this please This is

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

2019-07-18 Thread GitBox
HyukjinKwon commented on a change in pull request #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#discussion_r304780492 ## File path: mllib/src/test/scala/org/apache/spark/ml/linalg/VectorUDTSuite.scala ## @@ -44,4

[GitHub] [spark] AngersZhuuuu commented on issue #25028: [SPARK-28227][SQL] Support TRANSFORM with aggregation.

2019-07-18 Thread GitBox
AngersZh commented on issue #25028: [SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25028#issuecomment-512707345 > Yea, I agree with @wangyum's. Can we? @AngersZh Nowadays I am doing for support SparkThriftServer to enable

[GitHub] [spark] AmplabJenkins removed a comment on issue #25191: [MLLIB] Use TestingUtils to compare floating point values

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25191: [MLLIB] Use TestingUtils to compare floating point values URL: https://github.com/apache/spark/pull/25191#issuecomment-512705091 Can one of the admins verify this patch? This

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

2019-07-18 Thread GitBox
HyukjinKwon commented on a change in pull request #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#discussion_r304778424 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveInspectorSuite.scala ## @@

[GitHub] [spark] AmplabJenkins commented on issue #25191: [MLLIB] Use TestingUtils to compare floating point values

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25191: [MLLIB] Use TestingUtils to compare floating point values URL: https://github.com/apache/spark/pull/25191#issuecomment-512705808 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512705256 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

2019-07-18 Thread GitBox
HyukjinKwon commented on a change in pull request #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#discussion_r304777818 ## File path: mllib/pom.xml ## @@ -74,6 +74,19 @@ test-jar test +

[GitHub] [spark] AmplabJenkins removed a comment on issue #25191: [MLLIB] Use TestingUtils to compare floating point values

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25191: [MLLIB] Use TestingUtils to compare floating point values URL: https://github.com/apache/spark/pull/25191#issuecomment-512704923 Can one of the admins verify this patch? This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512705256 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512705253 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512705253 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25191: [MLLIB] Use TestingUtils to compare floating point values

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25191: [MLLIB] Use TestingUtils to compare floating point values URL: https://github.com/apache/spark/pull/25191#issuecomment-512705091 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512703892 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25191: [MLLIB] Use TestingUtils to compare floating point values

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25191: [MLLIB] Use TestingUtils to compare floating point values URL: https://github.com/apache/spark/pull/25191#issuecomment-512704923 Can one of the admins verify this patch? This is an

[GitHub] [spark] HyukjinKwon commented on issue #25028: [SPARK-28227][SQL] Support TRANSFORM with aggregation.

2019-07-18 Thread GitBox
HyukjinKwon commented on issue #25028: [SPARK-28227][SQL] Support TRANSFORM with aggregation. URL: https://github.com/apache/spark/pull/25028#issuecomment-512704718 Yea, I agree with @wangyum's. Can we? @AngersZh This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512703885 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
SparkQA removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512703347 **[Test build #107837 has

[GitHub] [spark] eugen-prokhorenko opened a new pull request #25191: [MLLIB] Use TestingUtils to compare floating point values

2019-07-18 Thread GitBox
eugen-prokhorenko opened a new pull request #25191: [MLLIB] Use TestingUtils to compare floating point values URL: https://github.com/apache/spark/pull/25191 ## What changes were proposed in this pull request? Use `org.apache.spark.mllib.util.TestingUtils` object across `MLLIB`

[GitHub] [spark] AmplabJenkins commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512703885 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
SparkQA commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512703873 **[Test build #107837 has

[GitHub] [spark] AmplabJenkins commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512703892 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] gaborgsomogyi commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

2019-07-18 Thread GitBox
gaborgsomogyi commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector URL: https://github.com/apache/spark/pull/25135#issuecomment-512703520 @zsxwing the main approach is created in agreement with the Kafka guys. The only thing which bothers me is

[GitHub] [spark] SparkQA commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
SparkQA commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512703347 **[Test build #107837 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-509637877 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-07-18 Thread GitBox
HyukjinKwon commented on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-512702827 ok to test This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string URL: https://github.com/apache/spark/pull/25190#issuecomment-512700096 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string URL: https://github.com/apache/spark/pull/25190#issuecomment-512700107 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] giamo commented on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-07-18 Thread GitBox
giamo commented on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#issuecomment-512700507 Thanks! I think I need an "ok to test" from a committer to start the Jenkins build, right?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#issuecomment-484510519 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string

2019-07-18 Thread GitBox
SparkQA commented on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string URL: https://github.com/apache/spark/pull/25190#issuecomment-512700721 **[Test build #107836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107836/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string URL: https://github.com/apache/spark/pull/25190#issuecomment-512700096 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string URL: https://github.com/apache/spark/pull/25190#issuecomment-512700107 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] wangyum opened a new pull request #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string

2019-07-18 Thread GitBox
wangyum opened a new pull request #25190: [SPARK-28429][SQL] Support timestamp binaryArithmetic string URL: https://github.com/apache/spark/pull/25190 ## What changes were proposed in this pull request? ``` ``` ## How was this patch tested? unit tests

[GitHub] [spark] yeshengm commented on issue #25186: [SPARK-28433][SQL]Special scala test case for aarch64

2019-07-18 Thread GitBox
yeshengm commented on issue #25186: [SPARK-28433][SQL]Special scala test case for aarch64 URL: https://github.com/apache/spark/pull/25186#issuecomment-512699226 Interesting! Could you post some refs? From my understanding, aarch64 FP ISA should fully support IEEE 754, then why there's a

[GitHub] [spark] vinodkc closed pull request #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread GitBox
vinodkc closed pull request #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base URL: https://github.com/apache/spark/pull/25113 This is an automated message from the Apache Git Service.

[GitHub] [spark] vinodkc commented on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread GitBox
vinodkc commented on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base URL: https://github.com/apache/spark/pull/25113#issuecomment-512698967 Closing this PR due to code synching will raise a new PR

[GitHub] [spark] SparkQA commented on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface

2019-07-18 Thread GitBox
SparkQA commented on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface URL: https://github.com/apache/spark/pull/25189#issuecomment-512698251 **[Test build #107835 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface URL: https://github.com/apache/spark/pull/25189#issuecomment-512697555 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface URL: https://github.com/apache/spark/pull/25189#issuecomment-512697561 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface URL: https://github.com/apache/spark/pull/25189#issuecomment-512697561 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface URL: https://github.com/apache/spark/pull/25189#issuecomment-512697555 Merged build finished. Test PASSed.

[GitHub] [spark] yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-18 Thread GitBox
yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304766364 ## File path:

[GitHub] [spark] yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-18 Thread GitBox
yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304765685 ## File path:

[GitHub] [spark] yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-18 Thread GitBox
yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304765685 ## File path:

[GitHub] [spark] wangyum commented on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface

2019-07-18 Thread GitBox
wangyum commented on issue #25189: [SPARK-28435][SQL] Support cast StringType to IntervalType for SQL interface URL: https://github.com/apache/spark/pull/25189#issuecomment-512696290 retest this please This is an automated

[GitHub] [spark] SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate

2019-07-18 Thread GitBox
SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate URL: https://github.com/apache/spark/pull/24637#issuecomment-512695948 **[Test build #107834 has

[GitHub] [spark] yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-18 Thread GitBox
yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304766364 ## File path:

[GitHub] [spark] SparkQA commented on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread GitBox
SparkQA commented on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base URL: https://github.com/apache/spark/pull/25113#issuecomment-512695870 **[Test build #107833 has

[GitHub] [spark] SparkQA commented on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

2019-07-18 Thread GitBox
SparkQA commented on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#issuecomment-512695867 **[Test build #107832 has

[GitHub] [spark] hehuiyuan commented on issue #24839: [SPARK-27258][K8S]Deal with the k8s resource names that don't match their own regular expression

2019-07-18 Thread GitBox
hehuiyuan commented on issue #24839: [SPARK-27258][K8S]Deal with the k8s resource names that don't match their own regular expression URL: https://github.com/apache/spark/pull/24839#issuecomment-512695456 ? This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate URL: https://github.com/apache/spark/pull/24637#issuecomment-512695338 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate URL: https://github.com/apache/spark/pull/24637#issuecomment-512695328 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base URL: https://github.com/apache/spark/pull/25113#issuecomment-512695276 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base URL: https://github.com/apache/spark/pull/25113#issuecomment-512695287 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate URL: https://github.com/apache/spark/pull/24637#issuecomment-512695338 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#issuecomment-512695244 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/23108#issuecomment-500153264 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate URL: https://github.com/apache/spark/pull/24637#issuecomment-512695328 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#issuecomment-512695248 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-18 Thread GitBox
yeshengm commented on a change in pull request #25164: [SPARK-28375][SQL] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304765685 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#issuecomment-512695248 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/23108#issuecomment-512695152 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#issuecomment-512695244 Merged build finished. Test PASSed.

[GitHub] [spark] chitralverma commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
chitralverma commented on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-512695277 @HyukjinKwon I'm merging the changes and testing. will ping you once its done. thanks

[GitHub] [spark] AmplabJenkins commented on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base URL: https://github.com/apache/spark/pull/25113#issuecomment-512695276 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins commented on issue #25113: [SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base URL: https://github.com/apache/spark/pull/25113#issuecomment-512695287 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

2019-07-18 Thread GitBox
viirya commented on issue #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#issuecomment-512694813 retest this please This is an

[GitHub] [spark] viirya commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate

2019-07-18 Thread GitBox
viirya commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate URL: https://github.com/apache/spark/pull/24637#issuecomment-512694668 retest this please This is an automated message from

[GitHub] [spark] chitralverma commented on a change in pull request #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread GitBox
chitralverma commented on a change in pull request #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#discussion_r304764441 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25103#issuecomment-512693135 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25180: [SPARK-28423][SQL] merge Scan and Batch/Stream

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25180: [SPARK-28423][SQL] merge Scan and Batch/Stream URL: https://github.com/apache/spark/pull/25180#issuecomment-512693077 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base

2019-07-18 Thread GitBox
AmplabJenkins removed a comment on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base URL: https://github.com/apache/spark/pull/25101#issuecomment-512693053 Test FAILed. Refer to this link for build results (access rights to CI server

<    5   6   7   8   9   10   11   12   >