[jira] [Resolved] (SPARK-30733) Fix SparkR tests per testthat and R version upgrade

[ https://issues.apache.org/jira/browse/SPARK-30733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30733. -- Resolution: Fixed Fixed at https://github.com/apache/spark/pull/27460 > Fix SparkR tests per

[jira] [Updated] (SPARK-30733) Fix SparkR tests per testthat and R version upgrade

[ https://issues.apache.org/jira/browse/SPARK-30733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30733: - Fix Version/s: 2.4.6 3.1.0 3.0.0 > Fix SparkR tests per

[jira] [Resolved] (SPARK-20964) Make some keywords reserved along with the ANSI/SQL standard

[ https://issues.apache.org/jira/browse/SPARK-20964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-20964. -- Fix Version/s: 3.0.0 Assignee: Takeshi Yamamuro Resolution: Fixed >

[jira] [Commented] (SPARK-20964) Make some keywords reserved along with the ANSI/SQL standard

[ https://issues.apache.org/jira/browse/SPARK-20964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030382#comment-17030382 ] Takeshi Yamamuro commented on SPARK-20964: -- Yea, thanks, [~dongjoon] ! I believe this has been

[jira] [Updated] (SPARK-30733) Fix SparkR tests per testthat and R version upgrade

[ https://issues.apache.org/jira/browse/SPARK-30733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30733: - Description: 5 SparkR tests seem being failed after upgrading testthat 2.0.0 and R 3.5.x

[jira] [Created] (SPARK-30737) Reenable to generate Rd files

Hyukjin Kwon created SPARK-30737: Summary: Reenable to generate Rd files Key: SPARK-30737 URL: https://issues.apache.org/jira/browse/SPARK-30737 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-30188) Fix tests when enable Adaptive Query Execution

[ https://issues.apache.org/jira/browse/SPARK-30188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-30188: --- Description: Fix the failed unit tests when enable Adaptive Query Execution. (was: Enable Adaptive Query

[jira] [Commented] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030334#comment-17030334 ] Mahima Khatri commented on SPARK-27298: --- As of now I do not have the environment setup to test

[jira] [Assigned] (SPARK-30736) One-Pass ChiSquareTest

[ https://issues.apache.org/jira/browse/SPARK-30736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30736: Assignee: zhengruifeng > One-Pass ChiSquareTest > -- > >

[jira] [Created] (SPARK-30736) One-Pass ChiSquareTest

zhengruifeng created SPARK-30736: Summary: One-Pass ChiSquareTest Key: SPARK-30736 URL: https://issues.apache.org/jira/browse/SPARK-30736 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomohiro Tanaka updated SPARK-30735: Attachment: repartition-before-partitionby.png > Improving writing performance by adding

[jira] [Updated] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomohiro Tanaka updated SPARK-30735: Description: h1. New functionality for {{partitionBy}} To enhance performance using

[jira] [Commented] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030331#comment-17030331 ] jiaan.geng commented on SPARK-28310: I will try to fix this ticket after

[jira] [Updated] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomohiro Tanaka updated SPARK-30735: Description: h1. New functionality for {{partitionBy}} To enhance performance using

[jira] [Created] (SPARK-30735) Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter

Tomohiro Tanaka created SPARK-30735: --- Summary: Improving writing performance by adding repartition based on columns to partitionBy for DataFrameWriter Key: SPARK-30735 URL:

[jira] [Created] (SPARK-30734) AnalysisException that window RangeFrame not match RowFrame

jiaan.geng created SPARK-30734: -- Summary: AnalysisException that window RangeFrame not match RowFrame Key: SPARK-30734 URL: https://issues.apache.org/jira/browse/SPARK-30734 Project: Spark

[jira] [Created] (SPARK-30733) Fix SparkR tests per testthat and R version upgrade

Hyukjin Kwon created SPARK-30733: Summary: Fix SparkR tests per testthat and R version upgrade Key: SPARK-30733 URL: https://issues.apache.org/jira/browse/SPARK-30733 Project: Spark Issue

[jira] [Commented] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030284#comment-17030284 ] Dongjoon Hyun commented on SPARK-28310: --- This is reverted via

[jira] [Closed] (SPARK-30726) ANSI SQL: FIRST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-30726. - > ANSI SQL: FIRST_VALUE function > -- > > Key:

[jira] [Closed] (SPARK-30727) ANSI SQL: LAST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-30727. - > ANSI SQL: LAST_VALUE function > - > > Key:

[jira] [Reopened] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-28310: --- Assignee: (was: Zhu, Lipeng) > ANSI SQL grammar support:

[jira] [Updated] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28310: -- Fix Version/s: (was: 3.0.0) > ANSI SQL grammar support:

[jira] [Resolved] (SPARK-30727) ANSI SQL: LAST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30727. --- Resolution: Duplicate > ANSI SQL: LAST_VALUE function > - > >

[jira] [Resolved] (SPARK-30726) ANSI SQL: FIRST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30726. --- Resolution: Duplicate > ANSI SQL: FIRST_VALUE function > -- > >

[jira] [Created] (SPARK-30732) BroadcastExchangeExec does not fully honor "spark.broadcast.compress"

Puneet created SPARK-30732: -- Summary: BroadcastExchangeExec does not fully honor "spark.broadcast.compress" Key: SPARK-30732 URL: https://issues.apache.org/jira/browse/SPARK-30732 Project: Spark

[jira] [Updated] (SPARK-30637) upgrade testthat on jenkins workers to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-30637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30637: - Fix Version/s: 3.0.0 2.4.5 > upgrade testthat on jenkins workers to 2.0.0 >

[jira] [Commented] (SPARK-23435) R tests should support latest testthat

[ https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030219#comment-17030219 ] Hyukjin Kwon commented on SPARK-23435: -- I think that's no problem. Thanks Shane! > R tests should

[jira] [Commented] (SPARK-30637) upgrade testthat on jenkins workers to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-30637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030218#comment-17030218 ] Hyukjin Kwon commented on SPARK-30637: -- Thanks, [~shaneknapp]! > upgrade testthat on jenkins

[jira] [Resolved] (SPARK-30637) upgrade testthat on jenkins workers to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-30637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30637. -- Resolution: Fixed > upgrade testthat on jenkins workers to 2.0.0 >

[jira] [Commented] (SPARK-23435) R tests should support latest testthat

[ https://issues.apache.org/jira/browse/SPARK-23435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030198#comment-17030198 ] Shane Knapp commented on SPARK-23435: - sadly (or not), i had to upgrade R to 3.5.2 on the centos

[jira] [Commented] (SPARK-30637) upgrade testthat on jenkins workers to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-30637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030194#comment-17030194 ] Shane Knapp commented on SPARK-30637: - i had to upgrade R to 3.5.2 on the centos

[jira] [Commented] (SPARK-16854) mapWithState Support for Python

[ https://issues.apache.org/jira/browse/SPARK-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030184#comment-17030184 ] Kelvin So commented on SPARK-16854: --- +1  Any update on this? > mapWithState Support for Python >

[jira] [Created] (SPARK-30731) Refine doc-building workflow

Nicholas Chammas created SPARK-30731: Summary: Refine doc-building workflow Key: SPARK-30731 URL: https://issues.apache.org/jira/browse/SPARK-30731 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-30637) upgrade testthat on jenkins workers to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-30637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030168#comment-17030168 ] Shane Knapp commented on SPARK-30637: - this is done! > upgrade testthat on jenkins workers to 2.0.0

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030132#comment-17030132 ] Dongjoon Hyun commented on SPARK-30730: --- Got it. Thank you for pinging me, [~maxgekk]. > Wrong

[jira] [Updated] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30730: --- Description: Currently, DateTimeUtils.convertTz() assumes that timestamp strings are casted to

[jira] [Commented] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

[ https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030122#comment-17030122 ] Maxim Gekk commented on SPARK-30730: [~dongjoon] FYI. 2.4.x may have this issue because CAST uses

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030114#comment-17030114 ] shanyu zhao commented on SPARK-30602: - Thanks for the effort Min! Riffle seems to only do map side

[jira] [Created] (SPARK-30730) Wrong results of `converTz` for different session and system time zones

Maxim Gekk created SPARK-30730: -- Summary: Wrong results of `converTz` for different session and system time zones Key: SPARK-30730 URL: https://issues.apache.org/jira/browse/SPARK-30730 Project: Spark

[jira] [Updated] (SPARK-30613) support hive style REPLACE COLUMN syntax

[ https://issues.apache.org/jira/browse/SPARK-30613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30613: -- Affects Version/s: (was: 3.0.0) 3.1.0 > support hive style REPLACE

[jira] [Updated] (SPARK-30610) spark worker graceful shutdown

[ https://issues.apache.org/jira/browse/SPARK-30610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30610: -- Affects Version/s: (was: 3.0.0) 3.1.0 > spark worker graceful

[jira] [Updated] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30602: -- Affects Version/s: (was: 3.0.0) 3.1.0 > SPIP: Support push-based

[jira] [Updated] (SPARK-30598) Detect equijoins better

[ https://issues.apache.org/jira/browse/SPARK-30598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30598: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Detect equijoins better >

[jira] [Updated] (SPARK-30616) Introduce TTL config option for SQL Parquet Metadata Cache

[ https://issues.apache.org/jira/browse/SPARK-30616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30616: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Introduce TTL config

[jira] [Updated] (SPARK-30648) Support filters pushdown in JSON datasource

[ https://issues.apache.org/jira/browse/SPARK-30648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30648: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support filters pushdown

[jira] [Updated] (SPARK-30631) Mitigate SQL injections - can't parameterize query parameters for JDBC connectors

[ https://issues.apache.org/jira/browse/SPARK-30631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30631: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Mitigate SQL injections -

[jira] [Updated] (SPARK-30664) Add more metrics to the all stages page

[ https://issues.apache.org/jira/browse/SPARK-30664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30664: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add more metrics to the

[jira] [Updated] (SPARK-30666) Reliable single-stage accumulators

[ https://issues.apache.org/jira/browse/SPARK-30666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30666: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Reliable single-stage

[jira] [Updated] (SPARK-30651) EXPLAIN EXTENDED does not show detail information for aggregate operators

[ https://issues.apache.org/jira/browse/SPARK-30651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30651: -- Affects Version/s: (was: 3.0.0) 3.1.0 > EXPLAIN EXTENDED does not

[jira] [Updated] (SPARK-30694) If exception occured while fetching blocks by ExternalBlockClient, fail early when External Shuffle Service is not alive

[ https://issues.apache.org/jira/browse/SPARK-30694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30694: -- Affects Version/s: (was: 3.0.0) 3.1.0 > If exception occured while

[jira] [Updated] (SPARK-30702) Support subexpression elimination in whole stage codegen

[ https://issues.apache.org/jira/browse/SPARK-30702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30702: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support subexpression

[jira] [Updated] (SPARK-30705) Improve CaseWhen sub-expression equality

[ https://issues.apache.org/jira/browse/SPARK-30705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30705: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve CaseWhen

[jira] [Updated] (SPARK-30712) Estimate sizeInBytes from file metadata for parquet files

[ https://issues.apache.org/jira/browse/SPARK-30712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30712: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Estimate sizeInBytes from

[jira] [Updated] (SPARK-30713) Respect mapOutputSize in memory in adaptive execution

[ https://issues.apache.org/jira/browse/SPARK-30713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30713: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Respect mapOutputSize in

[jira] [Updated] (SPARK-30703) Add a documentation page for ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30703: -- Target Version/s: 3.0.0 > Add a documentation page for ANSI mode >

[jira] [Updated] (SPARK-30685) Support ANSI INSERT syntax

[ https://issues.apache.org/jira/browse/SPARK-30685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30685: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support ANSI INSERT syntax

[jira] [Updated] (SPARK-30559) spark.sql.hive.caseSensitiveInferenceMode does not work with Hive

[ https://issues.apache.org/jira/browse/SPARK-30559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30559: -- Summary: spark.sql.hive.caseSensitiveInferenceMode does not work with Hive (was: Spark 2.4.4

[jira] [Commented] (SPARK-30559) Spark 2.4.4 - spark.sql.hive.caseSensitiveInferenceMode does not work with Hive

[ https://issues.apache.org/jira/browse/SPARK-30559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030083#comment-17030083 ] Dongjoon Hyun commented on SPARK-30559: --- Thank you for reporting with the detailed information.

[jira] [Updated] (SPARK-30711) 64KB JVM bytecode limit - janino.InternalCompilerException

[ https://issues.apache.org/jira/browse/SPARK-30711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30711: -- Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Updated] (SPARK-30729) Eagerly filter out zombie TaskSetManager before offering resources

[ https://issues.apache.org/jira/browse/SPARK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30729: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Eagerly filter out zombie

[jira] [Updated] (SPARK-30724) Support 'like any' and 'like all' operators

[ https://issues.apache.org/jira/browse/SPARK-30724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30724: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support 'like any' and

[jira] [Updated] (SPARK-30654) Update Docs Bootstrap to 4.4.1

[ https://issues.apache.org/jira/browse/SPARK-30654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30654: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Update Docs Bootstrap to

[jira] [Updated] (SPARK-30655) Update WebUI Bootstrap to 4.4.1

[ https://issues.apache.org/jira/browse/SPARK-30655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30655: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Update WebUI Bootstrap to

[jira] [Closed] (SPARK-30728) Bad signature for Spark 2.4.4

[ https://issues.apache.org/jira/browse/SPARK-30728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-30728. - > Bad signature for Spark 2.4.4 > - > > Key:

[jira] [Resolved] (SPARK-30728) Bad signature for Spark 2.4.4

[ https://issues.apache.org/jira/browse/SPARK-30728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30728. --- Resolution: Invalid Hi, [~khalidnajm]. JIRA is not for Q You had better ask questions to

[jira] [Created] (SPARK-30729) Eagerly filter out zombie TaskSetManager before offering resources

wuyi created SPARK-30729: Summary: Eagerly filter out zombie TaskSetManager before offering resources Key: SPARK-30729 URL: https://issues.apache.org/jira/browse/SPARK-30729 Project: Spark Issue

[jira] [Assigned] (SPARK-30725) Make all legacy SQL configs as internal configs

[ https://issues.apache.org/jira/browse/SPARK-30725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30725: --- Assignee: Maxim Gekk > Make all legacy SQL configs as internal configs >

[jira] [Resolved] (SPARK-30725) Make all legacy SQL configs as internal configs

[ https://issues.apache.org/jira/browse/SPARK-30725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30725. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27448

[jira] [Commented] (SPARK-23829) spark-sql-kafka source in spark 2.3 causes reading stream failure frequently

[ https://issues.apache.org/jira/browse/SPARK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029820#comment-17029820 ] Gabor Somogyi commented on SPARK-23829: --- [~BdLearner] I mean upstream Spark. > spark-sql-kafka

[jira] [Commented] (SPARK-30647) When creating a custom datasource File NotFoundExpection happens

[ https://issues.apache.org/jira/browse/SPARK-30647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029788#comment-17029788 ] Jorge Machado commented on SPARK-30647: --- 2.4x has the same issue. > When creating a custom

[jira] [Updated] (SPARK-30728) Bad signature for Spark 2.4.4

[ https://issues.apache.org/jira/browse/SPARK-30728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Khalid Najm updated SPARK-30728: Description: I downloaded the signatures files from the Apache Spark download page: *

[jira] [Updated] (SPARK-30728) Bad signature for Spark 2.4.4

[ https://issues.apache.org/jira/browse/SPARK-30728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Khalid Najm updated SPARK-30728: Description: I downloaded the signatures files from the Apache Spark download page: *

[jira] [Updated] (SPARK-30728) Bad signature for Spark 2.4.4

[ https://issues.apache.org/jira/browse/SPARK-30728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Khalid Najm updated SPARK-30728: Description: I downloaded the signatures files from the Apache Spark download page: *

[jira] [Created] (SPARK-30728) Bad signature for Spark 2.4.4

Khalid Najm created SPARK-30728: --- Summary: Bad signature for Spark 2.4.4 Key: SPARK-30728 URL: https://issues.apache.org/jira/browse/SPARK-30728 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30724) Support 'like any' and 'like all' operators

[ https://issues.apache.org/jira/browse/SPARK-30724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029762#comment-17029762 ] jiaan.geng commented on SPARK-30724:

[jira] [Commented] (SPARK-30721) Turning off WSCG did not take effect in AQE query planning

[ https://issues.apache.org/jira/browse/SPARK-30721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029760#comment-17029760 ] Wenchen Fan commented on SPARK-30721: - This is actually a false alert. We can turn off WSC with AQE,

[jira] [Updated] (SPARK-30721) fix DataFrameAggregateSuite when enabling AQE

[ https://issues.apache.org/jira/browse/SPARK-30721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30721: Summary: fix DataFrameAggregateSuite when enabling AQE (was: Turning off WSCG did not take

[jira] [Commented] (SPARK-28880) ANSI SQL: Bracketed comments

[ https://issues.apache.org/jira/browse/SPARK-28880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029752#comment-17029752 ] jiaan.geng commented on SPARK-28880: [~lixiao] > ANSI SQL: Bracketed comments >

[jira] [Commented] (SPARK-28880) ANSI SQL: Bracketed comments

[ https://issues.apache.org/jira/browse/SPARK-28880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029750#comment-17029750 ] jiaan.geng commented on SPARK-28880: I added test cases in AnalysisErrorSuite show below:  

[jira] [Comment Edited] (SPARK-30711) 64KB JVM bytecode limit - janino.InternalCompilerException

[ https://issues.apache.org/jira/browse/SPARK-30711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029724#comment-17029724 ] Kazuaki Ishizaki edited comment on SPARK-30711 at 2/4/20 10:20 AM: --- In

[jira] [Comment Edited] (SPARK-30711) 64KB JVM bytecode limit - janino.InternalCompilerException

[ https://issues.apache.org/jira/browse/SPARK-30711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029724#comment-17029724 ] Kazuaki Ishizaki edited comment on SPARK-30711 at 2/4/20 10:19 AM: --- In

[jira] [Commented] (SPARK-30711) 64KB JVM bytecode limit - janino.InternalCompilerException

[ https://issues.apache.org/jira/browse/SPARK-30711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029724#comment-17029724 ] Kazuaki Ishizaki commented on SPARK-30711: -- In my environment, both v3.0.0-preview and master

[jira] [Updated] (SPARK-30726) ANSI SQL: FIRST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30726: --- Description: I have checked PostgreSQL, Vertica, Oracle, Redshift, Presto, Teradata,

[jira] [Updated] (SPARK-30727) ANSI SQL: LAST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30727: --- Description: I have checked PostgreSQL, Vertica, Oracle, Redshift, Presto, Teradata,

[jira] [Updated] (SPARK-30727) ANSI SQL: LAST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30727: --- Parent: SPARK-30374 Issue Type: Sub-task (was: Bug) > ANSI SQL: LAST_VALUE function >

[jira] [Commented] (SPARK-30727) ANSI SQL: LAST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029721#comment-17029721 ] jiaan.geng commented on SPARK-30727: I'm working on. > ANSI SQL: LAST_VALUE function >

[jira] [Commented] (SPARK-30687) When reading from a file with pre-defined schema and encountering a single value that is not the same type as that of its column , Spark nullifies the entire row

[ https://issues.apache.org/jira/browse/SPARK-30687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029720#comment-17029720 ] pavithra ramachandran commented on SPARK-30687: --- yes. Issue is present 2.4.x also. > When

[jira] [Created] (SPARK-30727) ANSI SQL: LAST_VALUE function

jiaan.geng created SPARK-30727: -- Summary: ANSI SQL: LAST_VALUE function Key: SPARK-30727 URL: https://issues.apache.org/jira/browse/SPARK-30727 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30726) ANSI SQL: FIRST_VALUE function

[ https://issues.apache.org/jira/browse/SPARK-30726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029717#comment-17029717 ] jiaan.geng commented on SPARK-30726: I'm working on > ANSI SQL: FIRST_VALUE function >

[jira] [Created] (SPARK-30726) ANSI SQL: FIRST_VALUE function

jiaan.geng created SPARK-30726: -- Summary: ANSI SQL: FIRST_VALUE function Key: SPARK-30726 URL: https://issues.apache.org/jira/browse/SPARK-30726 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-23829) spark-sql-kafka source in spark 2.3 causes reading stream failure frequently

[ https://issues.apache.org/jira/browse/SPARK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029696#comment-17029696 ] Shyam commented on SPARK-23829: --- [~gsomogyi]  me new to kafka and spark , what do you mean spark-vanila

[jira] [Created] (SPARK-30725) Make all legacy SQL configs as internal configs

Maxim Gekk created SPARK-30725: -- Summary: Make all legacy SQL configs as internal configs Key: SPARK-30725 URL: https://issues.apache.org/jira/browse/SPARK-30725 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30711) 64KB JVM bytecode limit - janino.InternalCompilerException

[ https://issues.apache.org/jira/browse/SPARK-30711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029662#comment-17029662 ] Frederik Schreiber commented on SPARK-30711: Hey, i have run some tests here are the

[jira] [Commented] (SPARK-30724) Support 'like any' and 'like all' operators

[ https://issues.apache.org/jira/browse/SPARK-30724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029653#comment-17029653 ] jiaan.geng commented on SPARK-30724: I will investigate this feature. > Support 'like any' and

[jira] [Created] (SPARK-30724) Support 'like any' and 'like all' operators

Yuming Wang created SPARK-30724: --- Summary: Support 'like any' and 'like all' operators Key: SPARK-30724 URL: https://issues.apache.org/jira/browse/SPARK-30724 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029640#comment-17029640 ] Prashant Sharma commented on SPARK-25065: - I have an updated patch available for this issue, any