[GitHub] HyukjinKwon commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

HyukjinKwon commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251279489 ## File path:

[GitHub] AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994839 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994839 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457994547 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457994545 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457994545 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457994547 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] cloud-fan commented on a change in pull request #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line

cloud-fan commented on a change in pull request #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line URL: https://github.com/apache/spark/pull/23276#discussion_r251279295 ## File path:

[GitHub] SparkQA removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

SparkQA removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457968557 **[Test build #101738 has

[GitHub] cloud-fan commented on a change in pull request #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line

cloud-fan commented on a change in pull request #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line URL: https://github.com/apache/spark/pull/23276#discussion_r251279142 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994186 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] cloud-fan commented on a change in pull request #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line

cloud-fan commented on a change in pull request #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line URL: https://github.com/apache/spark/pull/23276#discussion_r251279142 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994183 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457994200 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

SparkQA commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-457994335 **[Test build #101738 has

[GitHub] AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457994203 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994186 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

SparkQA commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994177 **[Test build #101744 has

[GitHub] AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457994203 Test PASSed. Refer to this link for build results (access

[GitHub] SparkQA removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

SparkQA removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994012 **[Test build #101744 has

[GitHub] AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457994200 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994183 Merged build finished. Test FAILed.

[GitHub] dongjoon-hyun commented on a change in pull request #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

dongjoon-hyun commented on a change in pull request #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#discussion_r251278932 ## File path:

[GitHub] SparkQA commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

SparkQA commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457994012 **[Test build #101744 has

[GitHub] cloud-fan commented on a change in pull request #23662: [SPARK-26740][SQL] Make statistics of timestamp/date columns independent from system time zones

cloud-fan commented on a change in pull request #23662: [SPARK-26740][SQL] Make statistics of timestamp/date columns independent from system time zones URL: https://github.com/apache/spark/pull/23662#discussion_r251278634 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457982411 Can one of the admins verify this patch?

[GitHub] dongjoon-hyun commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

dongjoon-hyun commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457993828 ok to test This is an

[GitHub] dongjoon-hyun commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

dongjoon-hyun commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457993671 Thank you, @HeartSaVioR and @maropu .

[GitHub] cloud-fan commented on a change in pull request #23662: [SPARK-26740][SQL] Make statistics of timestamp/date columns independent from system time zones

cloud-fan commented on a change in pull request #23662: [SPARK-26740][SQL] Make statistics of timestamp/date columns independent from system time zones URL: https://github.com/apache/spark/pull/23662#discussion_r251278569 ## File path:

[GitHub] SparkQA commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

SparkQA commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457993454 **[Test build #101743 has

[GitHub] AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457993239 Test FAILed. Refer to this link for build results (access

[GitHub] AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457993236 Merged build finished. Test FAILed.

[GitHub] SparkQA removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

SparkQA removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457976229 **[Test build #101740 has

[GitHub] AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

AmplabJenkins removed a comment on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457993236 Merged build finished. Test FAILed.

[GitHub] maropu commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

maropu commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457993299 retest this please

[GitHub] AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

AmplabJenkins commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457993239 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] SparkQA commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp

SparkQA commented on issue #23656: [SPARK-26379][SS][BRANCH-2.3] Use dummy TimeZoneId to avoid UnresolvedException in CurrentBatchTimestamp URL: https://github.com/apache/spark/pull/23656#issuecomment-457993134 **[Test build #101740 has

[GitHub] cloud-fan commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

cloud-fan commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251278061 ## File path:

[GitHub] HyukjinKwon commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

HyukjinKwon commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251276720 ## File path:

[GitHub] AmplabJenkins commented on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default

AmplabJenkins commented on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default URL: https://github.com/apache/spark/pull/23625#issuecomment-457992296 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default

AmplabJenkins removed a comment on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default URL: https://github.com/apache/spark/pull/23625#issuecomment-457992302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default

AmplabJenkins removed a comment on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default URL: https://github.com/apache/spark/pull/23625#issuecomment-457992296 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins commented on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default

AmplabJenkins commented on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default URL: https://github.com/apache/spark/pull/23625#issuecomment-457992302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default

SparkQA commented on issue #23625: [SPARK-26700][CORE] enable fetch-big-block-to-memory by default URL: https://github.com/apache/spark/pull/23625#issuecomment-457992169 **[Test build #101742 has

[GitHub] maropu commented on issue #23580: [SPARK-26660]Add warning logs when broadcasting large task binary

maropu commented on issue #23580: [SPARK-26660]Add warning logs when broadcasting large task binary URL: https://github.com/apache/spark/pull/23580#issuecomment-457992125 I noticed, after this merged, the test log contains a lots of this warning message I feel abit annoying..

[GitHub] HyukjinKwon commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

HyukjinKwon commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251276768 ## File path:

[GitHub] HyukjinKwon commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

HyukjinKwon commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251276720 ## File path:

[GitHub] maropu commented on issue #23639: [SPARK-26716][SQL] FileFormat: the supported types of read/write should be consistent

maropu commented on issue #23639: [SPARK-26716][SQL] FileFormat: the supported types of read/write should be consistent URL: https://github.com/apache/spark/pull/23639#issuecomment-457990946 ok, thanks for the check. This is

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457990534 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457990538 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457990534 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457990538 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] cloud-fan commented on issue #23639: [SPARK-26716][SQL] FileFormat: the supported types of read/write should be consistent

cloud-fan commented on issue #23639: [SPARK-26716][SQL] FileFormat: the supported types of read/write should be consistent URL: https://github.com/apache/spark/pull/23639#issuecomment-457990299 I think it's very unlikely users will specify the schema as null type when reading orc files,

[GitHub] SparkQA removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457964890 **[Test build #101737 has

[GitHub] SparkQA commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457990306 **[Test build #101737 has

[GitHub] SparkQA removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

SparkQA removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457987393 **[Test build #101741 has

[GitHub] AmplabJenkins removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

AmplabJenkins removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457989440 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

AmplabJenkins commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457989440 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

AmplabJenkins removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457989437 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

AmplabJenkins commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457989437 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

SparkQA commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457989379 **[Test build #101741 has

[GitHub] HyukjinKwon commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV/JSON tables

HyukjinKwon commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV/JSON tables URL: https://github.com/apache/spark/pull/23336#issuecomment-457988470 @bersprockets, SPARK-26711 is fixed now. Do you mind if I ask to run the benchmark?

[GitHub] AmplabJenkins removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

AmplabJenkins removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457987705 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

AmplabJenkins removed a comment on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457987710 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

AmplabJenkins commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457987710 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

AmplabJenkins commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457987705 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

SparkQA commented on issue #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#issuecomment-457987393 **[Test build #101741 has

[GitHub] sumitsu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

sumitsu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251273243 ## File path:

[GitHub] HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#discussion_r251273479 ## File path: docs/configuration.md ## @@ -223,7 +225,8

[GitHub] HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#discussion_r251273479 ## File path: docs/configuration.md ## @@ -223,7 +225,8

[GitHub] sumitsu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

sumitsu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251273243 ## File path:

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457985889 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457985889 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457985892 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

AmplabJenkins removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457985892 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA removed a comment on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457962767 **[Test build #101735 has

[GitHub] HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#discussion_r251273045 ## File path: docs/configuration.md ## @@ -190,8

[GitHub] SparkQA commented on issue #23606: [SPARK-26666][SQL] Support DSv2 overwrite and dynamic partition overwrite.

SparkQA commented on issue #23606: [SPARK-2][SQL] Support DSv2 overwrite and dynamic partition overwrite. URL: https://github.com/apache/spark/pull/23606#issuecomment-457985631 **[Test build #101735 has

[GitHub] HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#discussion_r251272708 ## File path: docs/configuration.md ## @@ -190,8

[GitHub] HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource'

HyukjinKwon commented on a change in pull request #23664: [MINOR][DOCS] Add a note that 'spark.executor.pyspark.memory' is dependent on 'resource' URL: https://github.com/apache/spark/pull/23664#discussion_r251272826 ## File path: docs/configuration.md ## @@ -190,8

[GitHub] HeartSaVioR edited a comment on issue #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow in SS kafka rateLimit calculation

HeartSaVioR edited a comment on issue #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23652#issuecomment-457977860 Btw, I guess this patch add a new UT so please update the content of PR. And

[GitHub] maropu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

maropu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251271104 ## File path:

[GitHub] maropu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

maropu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251271148 ## File path:

[GitHub] maropu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

maropu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251271052 ## File path:

[GitHub] AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457982411 Can one of the admins verify this patch?

[GitHub] AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457982233 Can one of the admins verify this patch?

[GitHub] linehrr commented on issue #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow

linehrr commented on issue #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow URL: https://github.com/apache/spark/pull/23652#issuecomment-457982345 submitted this PR for master branch here: https://github.com/apache/spark/pull/23666, changed a bit on the PR title and reverted

[GitHub] AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457982233 Can one of the admins verify this patch?

[GitHub] AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins removed a comment on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457982183 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

AmplabJenkins commented on issue #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666#issuecomment-457982183 Can one of the admins verify this patch?

[GitHub] maropu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect

maropu commented on a change in pull request #23665: [SPARK-26745][SQL] Skip empty lines in JSON-derived DataFrames when skipParsing optimization in effect URL: https://github.com/apache/spark/pull/23665#discussion_r251270647 ## File path:

[GitHub] linehrr opened a new pull request #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation

linehrr opened a new pull request #23666: [SPARK-26718][SS][Master] Fixed integer overflow in SS kafka rateLimit calculation URL: https://github.com/apache/spark/pull/23666 ## What changes were proposed in this pull request? fix the integer overflow issue in rateLimit, refer to:

[GitHub] deshanxiao commented on a change in pull request #23637: [SPARK-26714][CORE][WEBUI] Show 0 partition job in WebUI

deshanxiao commented on a change in pull request #23637: [SPARK-26714][CORE][WEBUI] Show 0 partition job in WebUI URL: https://github.com/apache/spark/pull/23637#discussion_r251268717 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@

[GitHub] HeartSaVioR commented on issue #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow

HeartSaVioR commented on issue #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow URL: https://github.com/apache/spark/pull/23652#issuecomment-457977860 Btw, I guess this patch add a new UT so please update the content of PR. And we may want to get some information on

[GitHub] asfgit closed pull request #23663: [SPARK-26743][PYTHON] Adds a test to check the actual resource limit set via 'spark.executor.pyspark.memory'

asfgit closed pull request #23663: [SPARK-26743][PYTHON] Adds a test to check the actual resource limit set via 'spark.executor.pyspark.memory' URL: https://github.com/apache/spark/pull/23663 This is an automated message

[GitHub] HyukjinKwon commented on issue #23663: [SPARK-26743][PYTHON] Adds a test to check the actual resource limit set via 'spark.executor.pyspark.memory'

HyukjinKwon commented on issue #23663: [SPARK-26743][PYTHON] Adds a test to check the actual resource limit set via 'spark.executor.pyspark.memory' URL: https://github.com/apache/spark/pull/23663#issuecomment-457977448 Thanks guys! Merged to master.

[GitHub] HeartSaVioR commented on a change in pull request #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow

HeartSaVioR commented on a change in pull request #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow URL: https://github.com/apache/spark/pull/23652#discussion_r251266636 ## File path:

[GitHub] HyukjinKwon commented on a change in pull request #23622: [SPARK-26677][SQL] Disable dictionary filtering by default at Parquet

HyukjinKwon commented on a change in pull request #23622: [SPARK-26677][SQL] Disable dictionary filtering by default at Parquet URL: https://github.com/apache/spark/pull/23622#discussion_r251267116 ## File path:

[GitHub] HeartSaVioR commented on a change in pull request #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow

HeartSaVioR commented on a change in pull request #23652: [SPARK-26718][SS][BRANCH-2.4] Fixed integer overflow URL: https://github.com/apache/spark/pull/23652#discussion_r251266914 ## File path:

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r251266625 ## File path:

<    1   2   3   4   >