[jira] [Commented] (SPARK-25061) Spark SQL Thrift Server fails to not pick up hiveconf passing parameter

[ https://issues.apache.org/jira/browse/SPARK-25061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647537#comment-16647537 ] Yuming Wang commented on SPARK-25061: - Cloud you try to set it by: {code:sh} --conf

[jira] [Commented] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647481#comment-16647481 ] Wenchen Fan commented on SPARK-20236: - Hi [~deepanker], can you provide some code sn

[jira] [Commented] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647468#comment-16647468 ] Tomasz Radwan commented on SPARK-20236: --- Hello, Is the issue with saveAsTable con

[jira] [Resolved] (SPARK-25690) Analyzer rule "HandleNullInputsForUDF" does not stabilize and can be applied infinitely

[ https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25690. - Resolution: Fixed Assignee: Maryann Xue Fix Version/s: 2.4.0 > Analyzer rule "HandleNull

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647368#comment-16647368 ] Maciej Bryński commented on SPARK-25652: Exaclly. > Wrong datetime conversion

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647367#comment-16647367 ] Hyukjin Kwon commented on SPARK-25652: -- ah, I ruched to read. So the problem is the

[jira] [Comment Edited] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647364#comment-16647364 ] Maciej Bryński edited comment on SPARK-25652 at 10/12/18 3:19 AM:

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647364#comment-16647364 ] Maciej Bryński commented on SPARK-25652: The fold is added by Spark. It shouldn'

[jira] [Created] (SPARK-25716) Project and Aggregate generate valid constraints with unnecessary operation

SongYadong created SPARK-25716: -- Summary: Project and Aggregate generate valid constraints with unnecessary operation Key: SPARK-25716 URL: https://issues.apache.org/jira/browse/SPARK-25716 Project: Spar

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647363#comment-16647363 ] Hyukjin Kwon commented on SPARK-25652: -- Ah, so the problem is the fold is lost, rig

[jira] [Assigned] (SPARK-25388) checkEvaluation may miss incorrect nullable of DataType in the result

[ https://issues.apache.org/jira/browse/SPARK-25388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25388: --- Assignee: Kazuaki Ishizaki > checkEvaluation may miss incorrect nullable of DataType in the

[jira] [Resolved] (SPARK-25388) checkEvaluation may miss incorrect nullable of DataType in the result

[ https://issues.apache.org/jira/browse/SPARK-25388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25388. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22375 [https://gith

[jira] [Comment Edited] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647359#comment-16647359 ] Maciej Bryński edited comment on SPARK-25652 at 10/12/18 3:15 AM:

[jira] [Comment Edited] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647359#comment-16647359 ] Maciej Bryński edited comment on SPARK-25652 at 10/12/18 3:14 AM:

[jira] [Updated] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-25652: --- Description: Hi, I found strange behaviour of Spark when using datetime from night of changi

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647359#comment-16647359 ] Maciej Bryński commented on SPARK-25652: [~hyukjin.kwon] Sorry for late answer.

[jira] [Commented] (SPARK-25716) Project and Aggregate generate valid constraints with unnecessary operation

[ https://issues.apache.org/jira/browse/SPARK-25716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647358#comment-16647358 ] Apache Spark commented on SPARK-25716: -- User 'SongYadong' has created a pull reques

[jira] [Commented] (SPARK-25716) Project and Aggregate generate valid constraints with unnecessary operation

[ https://issues.apache.org/jira/browse/SPARK-25716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647355#comment-16647355 ] Apache Spark commented on SPARK-25716: -- User 'SongYadong' has created a pull reques

[jira] [Assigned] (SPARK-25716) Project and Aggregate generate valid constraints with unnecessary operation

[ https://issues.apache.org/jira/browse/SPARK-25716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25716: Assignee: (was: Apache Spark) > Project and Aggregate generate valid constraints with

[jira] [Assigned] (SPARK-25716) Project and Aggregate generate valid constraints with unnecessary operation

[ https://issues.apache.org/jira/browse/SPARK-25716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25716: Assignee: Apache Spark > Project and Aggregate generate valid constraints with unnecessar

[jira] [Commented] (SPARK-25715) support configuration on rpc port and port range on yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-25715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647340#comment-16647340 ] Tank Sui commented on SPARK-25715: -- {code:java} # https://github.com/apache/spark/blob

[jira] [Created] (SPARK-25715) support configuration on rpc port and port range on yarn client mode

Tank Sui created SPARK-25715: Summary: support configuration on rpc port and port range on yarn client mode Key: SPARK-25715 URL: https://issues.apache.org/jira/browse/SPARK-25715 Project: Spark

[jira] [Commented] (SPARK-25704) Replication of > 2GB block fails due to bad config default

[ https://issues.apache.org/jira/browse/SPARK-25704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647311#comment-16647311 ] Apache Spark commented on SPARK-25704: -- User 'squito' has created a pull request fo

[jira] [Commented] (SPARK-25704) Replication of > 2GB block fails due to bad config default

[ https://issues.apache.org/jira/browse/SPARK-25704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647310#comment-16647310 ] Apache Spark commented on SPARK-25704: -- User 'squito' has created a pull request fo

[jira] [Assigned] (SPARK-25704) Replication of > 2GB block fails due to bad config default

[ https://issues.apache.org/jira/browse/SPARK-25704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25704: Assignee: Imran Rashid (was: Apache Spark) > Replication of > 2GB block fails due to bad

[jira] [Assigned] (SPARK-25704) Replication of > 2GB block fails due to bad config default

[ https://issues.apache.org/jira/browse/SPARK-25704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25704: Assignee: Apache Spark (was: Imran Rashid) > Replication of > 2GB block fails due to bad

[jira] [Commented] (SPARK-25709) Can't append to a data source V2 unless target already has schema information or fixed schema matching dataframe

[ https://issues.apache.org/jira/browse/SPARK-25709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647286#comment-16647286 ] Hyukjin Kwon commented on SPARK-25709: -- This is basically duplicate of SPARK-25700

[jira] [Resolved] (SPARK-25709) Can't append to a data source V2 unless target already has schema information or fixed schema matching dataframe

[ https://issues.apache.org/jira/browse/SPARK-25709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25709. -- Resolution: Duplicate > Can't append to a data source V2 unless target already has schema info

[jira] [Commented] (SPARK-25709) Can't append to a data source V2 unless target already has schema information or fixed schema matching dataframe

[ https://issues.apache.org/jira/browse/SPARK-25709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647285#comment-16647285 ] Hyukjin Kwon commented on SPARK-25709: -- Please don't set the target versions and pr

[jira] [Updated] (SPARK-25709) Can't append to a data source V2 unless target already has schema information or fixed schema matching dataframe

[ https://issues.apache.org/jira/browse/SPARK-25709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25709: - Target Version/s: (was: 2.4.0) > Can't append to a data source V2 unless target already has sc

[jira] [Updated] (SPARK-25709) Can't append to a data source V2 unless target already has schema information or fixed schema matching dataframe

[ https://issues.apache.org/jira/browse/SPARK-25709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25709: - Priority: Major (was: Blocker) > Can't append to a data source V2 unless target already has sch

[jira] [Commented] (SPARK-25694) URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue

[ https://issues.apache.org/jira/browse/SPARK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647281#comment-16647281 ] Hyukjin Kwon commented on SPARK-25694: -- Please avoid to set target versions which a

[jira] [Updated] (SPARK-25694) URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue

[ https://issues.apache.org/jira/browse/SPARK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25694: - Target Version/s: (was: 2.3.2) > URL.setURLStreamHandlerFactory causing incompatible HttpURLCo

[jira] [Resolved] (SPARK-25679) OOM Killed observed for spark thrift executors with dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-25679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25679. -- Resolution: Invalid Questions should better go to mailing list as pointed out. > OOM Killed o

[jira] [Commented] (SPARK-25652) Wrong datetime conversion between Java and Python

[ https://issues.apache.org/jira/browse/SPARK-25652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647278#comment-16647278 ] Hyukjin Kwon commented on SPARK-25652: -- ping [~maver1ck] > Wrong datetime conversi

[jira] [Resolved] (SPARK-25684) Organize header related codes in CSV datasource

[ https://issues.apache.org/jira/browse/SPARK-25684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25684. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22676 [https://gi

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647139#comment-16647139 ] Sean Shubin commented on SPARK-14220: - Does the spark compatible with Scala 2.12 hav

[jira] [Assigned] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25681: Assignee: Apache Spark > Delegation Tokens fetched twice upon HadoopFSDelegationTokenProv

[jira] [Assigned] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25681: Assignee: (was: Apache Spark) > Delegation Tokens fetched twice upon HadoopFSDelegati

[jira] [Commented] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647132#comment-16647132 ] Apache Spark commented on SPARK-25681: -- User 'ifilonenko' has created a pull reques

[jira] [Assigned] (SPARK-25705) Remove Kafka 0.8 support in Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-25705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25705: Assignee: Apache Spark > Remove Kafka 0.8 support in Spark 3.0.0 > --

[jira] [Assigned] (SPARK-25705) Remove Kafka 0.8 support in Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-25705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25705: Assignee: (was: Apache Spark) > Remove Kafka 0.8 support in Spark 3.0.0 > ---

[jira] [Commented] (SPARK-25705) Remove Kafka 0.8 support in Spark 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-25705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647103#comment-16647103 ] Apache Spark commented on SPARK-25705: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25714: Assignee: Xiao Li (was: Apache Spark) > Null Handling in the Optimizer rule BooleanSimpl

[jira] [Assigned] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25714: Assignee: Apache Spark (was: Xiao Li) > Null Handling in the Optimizer rule BooleanSimpl

[jira] [Commented] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647067#comment-16647067 ] Apache Spark commented on SPARK-25714: -- User 'gatorsmile' has created a pull reques

[jira] [Commented] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16647065#comment-16647065 ] Apache Spark commented on SPARK-25714: -- User 'gatorsmile' has created a pull reques

[jira] [Resolved] (SPARK-25598) Remove flume connector in Spark 3

[ https://issues.apache.org/jira/browse/SPARK-25598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25598. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22692 [https://github.c

[jira] [Assigned] (SPARK-25598) Remove flume connector in Spark 3

[ https://issues.apache.org/jira/browse/SPARK-25598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25598: - Assignee: Sean Owen > Remove flume connector in Spark 3 > - > >

[jira] [Assigned] (SPARK-25674) If the records are incremented by more than 1 at a time,the number of bytes might rarely ever get updated

[ https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25674: - Assignee: liuxian > If the records are incremented by more than 1 at a time,the number of bytes

[jira] [Resolved] (SPARK-25674) If the records are incremented by more than 1 at a time,the number of bytes might rarely ever get updated

[ https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25674. --- Resolution: Fixed Fix Version/s: 2.4.0 3.0.0 2.3.3 Issu

[jira] [Updated] (SPARK-25674) If the records are incremented by more than 1 at a time,the number of bytes might rarely ever get updated

[ https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25674: -- Affects Version/s: 2.3.0 Fix Version/s: (was: 2.4.0) 2.4.1 > If the

[jira] [Assigned] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

[ https://issues.apache.org/jira/browse/SPARK-25615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25615: - Assignee: Dilip Biswal > KafkaSinkSuite: streaming - write to non-existing topic 1 min > --

[jira] [Resolved] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

[ https://issues.apache.org/jira/browse/SPARK-25615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25615. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22671 [https://github.c

[jira] [Resolved] (SPARK-24109) Remove class SnappyOutputStreamWrapper

[ https://issues.apache.org/jira/browse/SPARK-24109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24109. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22691 [https://github.c

[jira] [Updated] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25714: Target Version/s: 2.3.2, 2.2.2, 2.4.0 Priority: Blocker (was: Major) > Null Handling in the O

[jira] [Created] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

Xiao Li created SPARK-25714: --- Summary: Null Handling in the Optimizer rule BooleanSimplification Key: SPARK-25714 URL: https://issues.apache.org/jira/browse/SPARK-25714 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-25714) Null Handling in the Optimizer rule BooleanSimplification

[ https://issues.apache.org/jira/browse/SPARK-25714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25714: Labels: correctness (was: ) > Null Handling in the Optimizer rule BooleanSimplification > ---

[jira] [Resolved] (SPARK-25662) Refactor DataSourceReadBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-25662. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22664 [https://github.com/a

[jira] [Updated] (SPARK-25708) HAVING without GROUP BY means global aggregate

[ https://issues.apache.org/jira/browse/SPARK-25708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25708: Target Version/s: 2.4.0 > HAVING without GROUP BY means global aggregate > ---

[jira] [Assigned] (SPARK-25708) HAVING without GROUP BY means global aggregate

[ https://issues.apache.org/jira/browse/SPARK-25708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25708: --- Assignee: Wenchen Fan > HAVING without GROUP BY means global aggregate > --

[jira] [Commented] (SPARK-17206) Support ANALYZE TABLE on analyzable temoprary table/view

[ https://issues.apache.org/jira/browse/SPARK-17206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646984#comment-16646984 ] Scott Murray commented on SPARK-17206: -- Hello, We'd like to start using ANALYZE TA

[jira] [Created] (SPARK-25713) Implement copy() for ColumnarArray

Liwen Sun created SPARK-25713: - Summary: Implement copy() for ColumnarArray Key: SPARK-25713 URL: https://issues.apache.org/jira/browse/SPARK-25713 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-23904) Big execution plan cause OOM

[ https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646769#comment-16646769 ] Stanislav Los commented on SPARK-23904: --- for [~igreenfi] case I'd think setting pa

[jira] [Assigned] (SPARK-25690) Analyzer rule "HandleNullInputsForUDF" does not stabilize and can be applied infinitely

[ https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25690: Assignee: Apache Spark > Analyzer rule "HandleNullInputsForUDF" does not stabilize and ca

[jira] [Commented] (SPARK-25690) Analyzer rule "HandleNullInputsForUDF" does not stabilize and can be applied infinitely

[ https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646760#comment-16646760 ] Apache Spark commented on SPARK-25690: -- User 'maryannxue' has created a pull reques

[jira] [Assigned] (SPARK-25690) Analyzer rule "HandleNullInputsForUDF" does not stabilize and can be applied infinitely

[ https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25690: Assignee: (was: Apache Spark) > Analyzer rule "HandleNullInputsForUDF" does not stabi

[jira] [Updated] (SPARK-25690) Analyzer rule "HandleNullInputsForUDF" does not stabilize and can be applied infinitely

[ https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maryann Xue updated SPARK-25690: Description: This was fixed in SPARK-24891 and was then broken by SPARK-25044. The unit test in {

[jira] [Resolved] (SPARK-25700) Avoid to create a readsupport at write path in Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-25700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25700. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22688 [https://

[jira] [Assigned] (SPARK-25700) Avoid to create a readsupport at write path in Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-25700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25700: - Assignee: Hyukjin Kwon > Avoid to create a readsupport at write path in Data Source V2

[jira] [Commented] (SPARK-23904) Big execution plan cause OOM

[ https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646726#comment-16646726 ] Ruben Berenguel commented on SPARK-23904: - [~staslos] Interesting, thanks. I gue

[jira] [Commented] (SPARK-23904) Big execution plan cause OOM

[ https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646723#comment-16646723 ] Stanislav Los commented on SPARK-23904: --- [~igreenfi] [~RBerenguel] we had the same

[jira] [Updated] (SPARK-25712) Improve usage message of start-master.sh and start-slave.sh

[ https://issues.apache.org/jira/browse/SPARK-25712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25712: -- Priority: Minor (was: Major) > Improve usage message of start-master.sh and start-slave.sh >

[jira] [Updated] (SPARK-25711) Allow history server to show usage

[ https://issues.apache.org/jira/browse/SPARK-25711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25711: -- Priority: Minor (was: Major) Not major > Allow history server to show usage > --

[jira] [Commented] (SPARK-25712) Improve usage message of start-master.sh and start-slave.sh

[ https://issues.apache.org/jira/browse/SPARK-25712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646658#comment-16646658 ] Apache Spark commented on SPARK-25712: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25712) Improve usage message of start-master.sh and start-slave.sh

[ https://issues.apache.org/jira/browse/SPARK-25712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25712: Assignee: (was: Apache Spark) > Improve usage message of start-master.sh and start-sl

[jira] [Assigned] (SPARK-25712) Improve usage message of start-master.sh and start-slave.sh

[ https://issues.apache.org/jira/browse/SPARK-25712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25712: Assignee: Apache Spark > Improve usage message of start-master.sh and start-slave.sh > --

[jira] [Commented] (SPARK-25712) Improve usage message of start-master.sh and start-slave.sh

[ https://issues.apache.org/jira/browse/SPARK-25712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646657#comment-16646657 ] Apache Spark commented on SPARK-25712: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-25712) Improve usage message of start-master.sh and start-slave.sh

Gengliang Wang created SPARK-25712: -- Summary: Improve usage message of start-master.sh and start-slave.sh Key: SPARK-25712 URL: https://issues.apache.org/jira/browse/SPARK-25712 Project: Spark

[jira] [Assigned] (SPARK-25711) Allow history server to show usage

[ https://issues.apache.org/jira/browse/SPARK-25711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25711: Assignee: Apache Spark > Allow history server to show usage > ---

[jira] [Commented] (SPARK-25711) Allow history server to show usage

[ https://issues.apache.org/jira/browse/SPARK-25711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646631#comment-16646631 ] Apache Spark commented on SPARK-25711: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-25711) Allow history server to show usage

[ https://issues.apache.org/jira/browse/SPARK-25711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25711: Assignee: (was: Apache Spark) > Allow history server to show usage >

[jira] [Created] (SPARK-25711) Allow history server to show usage

Gengliang Wang created SPARK-25711: -- Summary: Allow history server to show usage Key: SPARK-25711 URL: https://issues.apache.org/jira/browse/SPARK-25711 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-25362) Replace Spark Optional class with Java Optional

[ https://issues.apache.org/jira/browse/SPARK-25362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646601#comment-16646601 ] Apache Spark commented on SPARK-25362: -- User 'mmolimar' has created a pull request

[jira] [Assigned] (SPARK-25362) Replace Spark Optional class with Java Optional

[ https://issues.apache.org/jira/browse/SPARK-25362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25362: Assignee: (was: Apache Spark) > Replace Spark Optional class with Java Optional > ---

[jira] [Assigned] (SPARK-25362) Replace Spark Optional class with Java Optional

[ https://issues.apache.org/jira/browse/SPARK-25362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25362: Assignee: Apache Spark > Replace Spark Optional class with Java Optional > --

[jira] [Commented] (SPARK-25710) range should report metrics correctly

[ https://issues.apache.org/jira/browse/SPARK-25710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646555#comment-16646555 ] Apache Spark commented on SPARK-25710: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-25710) range should report metrics correctly

[ https://issues.apache.org/jira/browse/SPARK-25710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646552#comment-16646552 ] Apache Spark commented on SPARK-25710: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-25710) range should report metrics correctly

[ https://issues.apache.org/jira/browse/SPARK-25710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25710: Assignee: Apache Spark (was: Wenchen Fan) > range should report metrics correctly >

[jira] [Assigned] (SPARK-25710) range should report metrics correctly

[ https://issues.apache.org/jira/browse/SPARK-25710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25710: Assignee: Wenchen Fan (was: Apache Spark) > range should report metrics correctly >

[jira] [Created] (SPARK-25710) range should report metrics correctly

Wenchen Fan created SPARK-25710: --- Summary: range should report metrics correctly Key: SPARK-25710 URL: https://issues.apache.org/jira/browse/SPARK-25710 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-24429) Add support for spark.driver.extraJavaOptions in cluster mode for Spark on K8s

[ https://issues.apache.org/jira/browse/SPARK-24429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24429. - Resolution: Not A Problem > Add support for spark.driver.extraJavaOptions in cluster mode for Sp

[jira] [Commented] (SPARK-24429) Add support for spark.driver.extraJavaOptions in cluster mode for Spark on K8s

[ https://issues.apache.org/jira/browse/SPARK-24429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646444#comment-16646444 ] Stavros Kontopoulos commented on SPARK-24429: - [~cloud_fan] let's close this

[jira] [Commented] (SPARK-24793) Make spark-submit more useful with k8s

[ https://issues.apache.org/jira/browse/SPARK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646423#comment-16646423 ] Stavros Kontopoulos commented on SPARK-24793: - Hi [~foxish] are you working

[jira] [Commented] (SPARK-25686) date_trunc Spark SQL function silently returns null if parameters are swapped

[ https://issues.apache.org/jira/browse/SPARK-25686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646394#comment-16646394 ] Zack Behringer commented on SPARK-25686: OK, I thought that might be the case >

[jira] [Comment Edited] (SPARK-25679) OOM Killed observed for spark thrift executors with dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-25679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646293#comment-16646293 ] Yuming Wang edited comment on SPARK-25679 at 10/11/18 12:55 PM: --

[jira] [Commented] (SPARK-25700) Avoid to create a readsupport at write path in Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-25700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646375#comment-16646375 ] Apache Spark commented on SPARK-25700: -- User 'HyukjinKwon' has created a pull reque

[jira] [Updated] (SPARK-25708) HAVING without GROUP BY means global aggregate

[ https://issues.apache.org/jira/browse/SPARK-25708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-25708: -- Labels: correctness release-notes (was: correctness) > HAVING without GROUP BY means

[jira] [Created] (SPARK-25709) Can't append to a data source V2 unless target already has schema information or fixed schema matching dataframe

Assaf Mendelson created SPARK-25709: --- Summary: Can't append to a data source V2 unless target already has schema information or fixed schema matching dataframe Key: SPARK-25709 URL: https://issues.apache.org/jir

[jira] [Assigned] (SPARK-25708) HAVING without GROUP BY means global aggregate

[ https://issues.apache.org/jira/browse/SPARK-25708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25708: Assignee: Apache Spark > HAVING without GROUP BY means global aggregate > ---

  1   2   >