[jira] [Commented] (SPARK-34445) Make `spark.sql.legacy.replaceDatabricksSparkAvro.enabled` as non-internal

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285081#comment-17285081 ] Apache Spark commented on SPARK-34445: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34445) Make `spark.sql.legacy.replaceDatabricksSparkAvro.enabled` as non-internal

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34445: Assignee: Apache Spark > Make `spark.sql.legacy.replaceDatabricksSparkAvro.enabled` as no

[jira] [Assigned] (SPARK-34445) Make `spark.sql.legacy.replaceDatabricksSparkAvro.enabled` as non-internal

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34445: Assignee: (was: Apache Spark) > Make `spark.sql.legacy.replaceDatabricksSparkAvro.ena

[jira] [Updated] (SPARK-34446) Add documentation for full outer and left semi stream-stream join

2021-02-16 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34446: - Parent: SPARK-32883 Issue Type: Sub-task (was: Documentation) > Add documentation for full oute

[jira] [Created] (SPARK-34446) Add documentation for full outer and left semi stream-stream join

2021-02-16 Thread Cheng Su (Jira)
Cheng Su created SPARK-34446: Summary: Add documentation for full outer and left semi stream-stream join Key: SPARK-34446 URL: https://issues.apache.org/jira/browse/SPARK-34446 Project: Spark Is

[jira] [Assigned] (SPARK-34446) Add documentation for full outer and left semi stream-stream join

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34446: Assignee: (was: Apache Spark) > Add documentation for full outer and left semi stream

[jira] [Commented] (SPARK-34446) Add documentation for full outer and left semi stream-stream join

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285088#comment-17285088 ] Apache Spark commented on SPARK-34446: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-34446) Add documentation for full outer and left semi stream-stream join

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34446: Assignee: Apache Spark > Add documentation for full outer and left semi stream-stream joi

[jira] [Commented] (SPARK-34446) Add documentation for full outer and left semi stream-stream join

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285090#comment-17285090 ] Apache Spark commented on SPARK-34446: -- User 'c21' has created a pull request for t

[jira] [Created] (SPARK-34447) Refactor the unified v1 and v2 command tests

2021-02-16 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34447: -- Summary: Refactor the unified v1 and v2 command tests Key: SPARK-34447 URL: https://issues.apache.org/jira/browse/SPARK-34447 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-34444) Pushdown scalar-subquery filter to FileSourceScan

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: (was: Apache Spark) > Pushdown scalar-subquery filter to FileSourceScan > -

[jira] [Assigned] (SPARK-34444) Pushdown scalar-subquery filter to FileSourceScan

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Apache Spark > Pushdown scalar-subquery filter to FileSourceScan >

[jira] [Commented] (SPARK-34444) Pushdown scalar-subquery filter to FileSourceScan

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285149#comment-17285149 ] Apache Spark commented on SPARK-3: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-34444) Pushdown scalar-subquery filter to FileSourceScan

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285150#comment-17285150 ] Apache Spark commented on SPARK-3: -- User 'wangyum' has created a pull request f

[jira] [Updated] (SPARK-34444) Pushdown scalar-subquery filter to FileSourceScan

2021-02-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-3: Description: We can pushdown {{a < (select max(d) from t2)}} to FileSourceScan: {code:scala} sql("

[jira] [Commented] (SPARK-21453) Cached Kafka consumer may be closed too early

2021-02-16 Thread Julian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285168#comment-17285168 ] Julian commented on SPARK-21453: Hi, it's been quite my side as we have been migrating H

[jira] [Created] (SPARK-34448) Under certain conditions the binary logistic regression incorrectly computes the intercept and coefficients

2021-02-16 Thread Yakov Kerzhner (Jira)
Yakov Kerzhner created SPARK-34448: -- Summary: Under certain conditions the binary logistic regression incorrectly computes the intercept and coefficients Key: SPARK-34448 URL: https://issues.apache.org/jira/brows

[jira] [Updated] (SPARK-34448) Under certain conditions the binary logistic regression incorrectly computes the intercept and coefficients

2021-02-16 Thread Yakov Kerzhner (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yakov Kerzhner updated SPARK-34448: --- Labels: correctness (was: ) > Under certain conditions the binary logistic regression incor

[jira] [Assigned] (SPARK-34426) Add driver and executors POD logs to integration tests log when the test fails

2021-02-16 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-34426: Assignee: Attila Zsolt Piros > Add driver and executors POD logs to integration tests log

[jira] [Resolved] (SPARK-34426) Add driver and executors POD logs to integration tests log when the test fails

2021-02-16 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-34426. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31561 [https://gi

[jira] [Resolved] (SPARK-34333) Fix PostgresDialect to handle money types properly

2021-02-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-34333. Fix Version/s: 3.2.0 Resolution: Fixed This issue is resolved by https://github.com

[jira] [Commented] (SPARK-34409) haversine distance spark function

2021-02-16 Thread Darshan Jani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285601#comment-17285601 ] Darshan Jani commented on SPARK-34409: -- Suggestion to add in spark is to support op

[jira] [Comment Edited] (SPARK-34409) haversine distance spark function

2021-02-16 Thread Darshan Jani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285601#comment-17285601 ] Darshan Jani edited comment on SPARK-34409 at 2/17/21, 2:01 AM: --

[jira] [Commented] (SPARK-34441) from_json documentation is wrong about malformed JSONs output

2021-02-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285602#comment-17285602 ] Hyukjin Kwon commented on SPARK-34441: -- [~jeanfrancisroy] can you share your codes

[jira] [Comment Edited] (SPARK-34409) haversine distance spark function

2021-02-16 Thread Darshan Jani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285601#comment-17285601 ] Darshan Jani edited comment on SPARK-34409 at 2/17/21, 2:32 AM: --

[jira] [Commented] (SPARK-34441) from_json documentation is wrong about malformed JSONs output

2021-02-16 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285618#comment-17285618 ] Jean-Francis Roy commented on SPARK-34441: -- [~hyukjin.kwon] of course, here is

[jira] [Comment Edited] (SPARK-34441) from_json documentation is wrong about malformed JSONs output

2021-02-16 Thread Jean-Francis Roy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285618#comment-17285618 ] Jean-Francis Roy edited comment on SPARK-34441 at 2/17/21, 3:17 AM: --

[jira] [Created] (SPARK-34449) Upgrade Jetty to fix CVE-2020-27218

2021-02-16 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34449: -- Summary: Upgrade Jetty to fix CVE-2020-27218 Key: SPARK-34449 URL: https://issues.apache.org/jira/browse/SPARK-34449 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34449) Upgrade Jetty to fix CVE-2020-27218

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285621#comment-17285621 ] Apache Spark commented on SPARK-34449: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-34449) Upgrade Jetty to fix CVE-2020-27218

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285620#comment-17285620 ] Apache Spark commented on SPARK-34449: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34449) Upgrade Jetty to fix CVE-2020-27218

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34449: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade Jetty to fix CVE-2020-27218 > ---

[jira] [Assigned] (SPARK-34449) Upgrade Jetty to fix CVE-2020-27218

2021-02-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34449: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade Jetty to fix CVE-2020-27218 > ---

[jira] [Commented] (SPARK-34441) from_json documentation is wrong about malformed JSONs output

2021-02-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285625#comment-17285625 ] Hyukjin Kwon commented on SPARK-34441: -- You can workaround as below: {code:scala}

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

2021-02-16 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285663#comment-17285663 ] Izek Greenfield commented on SPARK-8582: [~zsxwing] Why that Jira closed? I still