[jira] [Resolved] (SPARK-49560) TABLESAMPLE operator

[ https://issues.apache.org/jira/browse/SPARK-49560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49560. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48168 [https:

[jira] [Assigned] (SPARK-49557) WHERE operator

[ https://issues.apache.org/jira/browse/SPARK-49557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-49557: -- Assignee: Daniel > WHERE operator > -- > > Key: SPARK-495

[jira] [Resolved] (SPARK-49557) WHERE operator

[ https://issues.apache.org/jira/browse/SPARK-49557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49557. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48091 [https:

[jira] [Assigned] (SPARK-48939) Support recursive reference of Avro schema

[ https://issues.apache.org/jira/browse/SPARK-48939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48939: -- Assignee: Yuchen Liu > Support recursive reference of Avro schema > -

[jira] [Resolved] (SPARK-48939) Support recursive reference of Avro schema

[ https://issues.apache.org/jira/browse/SPARK-48939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48939. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48043 [https:

[jira] [Resolved] (SPARK-49015) Connect Server should respect spark.log.structuredLogging.enabled

[ https://issues.apache.org/jira/browse/SPARK-49015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49015. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47500 [https:

[jira] [Assigned] (SPARK-49015) Connect Server should respect spark.log.structuredLogging.enabled

[ https://issues.apache.org/jira/browse/SPARK-49015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-49015: -- Assignee: Cheng Pan > Connect Server should respect spark.log.structuredLogging.enabl

[jira] [Resolved] (SPARK-49454) Avoid double normalization in the cache process

[ https://issues.apache.org/jira/browse/SPARK-49454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49454. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47923 [https:

[jira] [Assigned] (SPARK-49454) Avoid double normalization in the cache process

[ https://issues.apache.org/jira/browse/SPARK-49454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-49454: -- Assignee: Xinyi Yu > Avoid double normalization in the cache process > --

[jira] [Resolved] (SPARK-49338) Make Spark Deamons support `spark.log.structuredLogging.enabled`

[ https://issues.apache.org/jira/browse/SPARK-49338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49338. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47831 [https:

[jira] [Assigned] (SPARK-49338) Make Spark Deamons support `spark.log.structuredLogging.enabled`

[ https://issues.apache.org/jira/browse/SPARK-49338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-49338: -- Assignee: Dongjoon Hyun > Make Spark Deamons support `spark.log.structuredLogging.ena

[jira] [Resolved] (SPARK-49113) Remove assert when translating expressions in DataSourceStrategy when

[ https://issues.apache.org/jira/browse/SPARK-49113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49113. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47611 [https:

[jira] [Assigned] (SPARK-49113) Remove assert when translating expressions in DataSourceStrategy when

[ https://issues.apache.org/jira/browse/SPARK-49113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-49113: -- Assignee: Milan Stefanovic > Remove assert when translating expressions in DataSource

[jira] [Assigned] (SPARK-49318) Preempt low priority LCA internal error until the end of check analysis

[ https://issues.apache.org/jira/browse/SPARK-49318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-49318: -- Assignee: Xinyi Yu > Preempt low priority LCA internal error until the end of check a

[jira] [Resolved] (SPARK-49318) Preempt low priority LCA internal error until the end of check analysis

[ https://issues.apache.org/jira/browse/SPARK-49318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49318. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47813 [https:

[jira] [Resolved] (SPARK-49216) Fix to not log message context with explicitly LogEntry constructed when Structured Logging conf is off

[ https://issues.apache.org/jira/browse/SPARK-49216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49216. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47732 [https:

[jira] [Assigned] (SPARK-49216) Fix to not log message context with explicitly LogEntry constructed when Structured Logging conf is off

[ https://issues.apache.org/jira/browse/SPARK-49216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-49216: -- Assignee: Xinyi Yu > Fix to not log message context with explicitly LogEntry construc

[jira] [Resolved] (SPARK-30374) Feature Parity between PostgreSQL and Spark (ANSI/SQL)

[ https://issues.apache.org/jira/browse/SPARK-30374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-30374. Assignee: Apache Spark Resolution: Done > Feature Parity between PostgreSQL and Spar

[jira] [Resolved] (SPARK-49054) Column default value should support current_* functions

[ https://issues.apache.org/jira/browse/SPARK-49054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-49054. Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 47538 [https:

[jira] [Updated] (SPARK-49054) Column default value should support current_* functions

[ https://issues.apache.org/jira/browse/SPARK-49054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-49054: --- Affects Version/s: 3.5.2 > Column default value should support current_* functions > ---

[jira] [Created] (SPARK-49054) Column default value should support current_* functions

Gengliang Wang created SPARK-49054: -- Summary: Column default value should support current_* functions Key: SPARK-49054 URL: https://issues.apache.org/jira/browse/SPARK-49054 Project: Spark I

[jira] [Assigned] (SPARK-48740) Catch missing window specification error early

[ https://issues.apache.org/jira/browse/SPARK-48740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48740: -- Assignee: Amanda Liu > Catch missing window specification error early > -

[jira] [Resolved] (SPARK-48740) Catch missing window specification error early

[ https://issues.apache.org/jira/browse/SPARK-48740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48740. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47129 [https:

[jira] [Assigned] (SPARK-48929) View fails with internal error after upgrade causes expected syntax error.

[ https://issues.apache.org/jira/browse/SPARK-48929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48929: -- Assignee: Serge Rielau > View fails with internal error after upgrade causes expected

[jira] [Resolved] (SPARK-48929) View fails with internal error after upgrade causes expected syntax error.

[ https://issues.apache.org/jira/browse/SPARK-48929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48929. Resolution: Fixed Issue resolved by pull request 47405 [https://github.com/apache/spark/pu

[jira] [Assigned] (SPARK-48592) Add scala style check for logging message inline variables

[ https://issues.apache.org/jira/browse/SPARK-48592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48592: -- Assignee: Amanda Liu > Add scala style check for logging message inline variables > -

[jira] [Resolved] (SPARK-48592) Add scala style check for logging message inline variables

[ https://issues.apache.org/jira/browse/SPARK-48592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48592. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47239 [https:

[jira] [Assigned] (SPARK-48890) Add Streaming related fields to log4j ThreadContext

[ https://issues.apache.org/jira/browse/SPARK-48890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48890: -- Assignee: Wei Liu > Add Streaming related fields to log4j ThreadContext > ---

[jira] [Resolved] (SPARK-48890) Add Streaming related fields to log4j ThreadContext

[ https://issues.apache.org/jira/browse/SPARK-48890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48890. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47340 [https:

[jira] [Resolved] (SPARK-48744) Log entry should be constructed only once

[ https://issues.apache.org/jira/browse/SPARK-48744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48744. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47135 [https:

[jira] [Updated] (SPARK-48744) Log entry should be constructed only once

[ https://issues.apache.org/jira/browse/SPARK-48744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48744: --- Description: In the current implementation:   {code:java} class LogEntry(messageWithContext

[jira] [Updated] (SPARK-48744) Log entry should be constructed only once

[ https://issues.apache.org/jira/browse/SPARK-48744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48744: --- Description: In the current implementation: ``` class LogEntry(messageWithContext: => Mess

[jira] [Created] (SPARK-48744) Log entry should be constructed once

Gengliang Wang created SPARK-48744: -- Summary: Log entry should be constructed once Key: SPARK-48744 URL: https://issues.apache.org/jira/browse/SPARK-48744 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48744) Log entry should be constructed only once

[ https://issues.apache.org/jira/browse/SPARK-48744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48744: --- Summary: Log entry should be constructed only once (was: Log entry should be constructed on

[jira] [Resolved] (SPARK-48629) Migrate the remaining code to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48629. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46986 [https:

[jira] [Resolved] (SPARK-48545) Create to_avro and from_avro SQL functions to match PySpark equivalent

[ https://issues.apache.org/jira/browse/SPARK-48545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48545. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46977 [https:

[jira] [Assigned] (SPARK-48545) Create to_avro and from_avro SQL functions to match PySpark equivalent

[ https://issues.apache.org/jira/browse/SPARK-48545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48545: -- Assignee: Daniel > Create to_avro and from_avro SQL functions to match PySpark equiva

[jira] [Resolved] (SPARK-48623) Structured Logging Framework Scala Style Migration

[ https://issues.apache.org/jira/browse/SPARK-48623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48623. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46980 [https:

[jira] [Assigned] (SPARK-48623) Structured Logging Framework Scala Style Migration

[ https://issues.apache.org/jira/browse/SPARK-48623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48623: -- Assignee: Amanda Liu > Structured Logging Framework Scala Style Migration > -

[jira] [Resolved] (SPARK-47579) Spark core: Migrate logInfo with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47579. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46951 [https:

[jira] [Assigned] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-48611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48611: -- Assignee: Cheng Pan > Log TID for input split in HadoopRDD and NewHadoopRDD > ---

[jira] [Resolved] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-48611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48611. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46966 [https:

[jira] [Updated] (SPARK-48626) Change the scope of object LogKeys as private in Spark

[ https://issues.apache.org/jira/browse/SPARK-48626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48626: --- Summary: Change the scope of object LogKeys as private in Spark (was: Change the scope of o

[jira] [Created] (SPARK-48626) Change the scope of object LogKyes as private in Spark

Gengliang Wang created SPARK-48626: -- Summary: Change the scope of object LogKyes as private in Spark Key: SPARK-48626 URL: https://issues.apache.org/jira/browse/SPARK-48626 Project: Spark Is

[jira] [Commented] (SPARK-48545) Create from_avro SQL function to match PySpark equivalent

[ https://issues.apache.org/jira/browse/SPARK-48545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852593#comment-17852593 ] Gengliang Wang commented on SPARK-48545: +1 for having such functions (from_avro

[jira] [Assigned] (SPARK-47977) DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception

[ https://issues.apache.org/jira/browse/SPARK-47977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47977: -- Assignee: Vitalii Li > DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd sho

[jira] [Resolved] (SPARK-47977) DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception

[ https://issues.apache.org/jira/browse/SPARK-47977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47977. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46210 [https:

[jira] [Assigned] (SPARK-48488) Restore the original logic of methods `log[info|warning|error]` in `SparkSubmit`

[ https://issues.apache.org/jira/browse/SPARK-48488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48488: -- Assignee: BingKun Pan > Restore the original logic of methods `log[info|warning|error

[jira] [Resolved] (SPARK-48488) Restore the original logic of methods `log[info|warning|error]` in `SparkSubmit`

[ https://issues.apache.org/jira/browse/SPARK-48488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48488. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46822 [https:

[jira] [Assigned] (SPARK-48490) Unescapes any literals for message of MessageWithContext

[ https://issues.apache.org/jira/browse/SPARK-48490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48490: -- Assignee: BingKun Pan > Unescapes any literals for message of MessageWithContext > --

[jira] [Resolved] (SPARK-48490) Unescapes any literals for message of MessageWithContext

[ https://issues.apache.org/jira/browse/SPARK-48490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48490. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46824 [https:

[jira] [Assigned] (SPARK-48320) Add external third-party ecosystem access guide to the doc

[ https://issues.apache.org/jira/browse/SPARK-48320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48320: -- Assignee: BingKun Pan > Add external third-party ecosystem access guide to the doc >

[jira] [Resolved] (SPARK-48320) Add external third-party ecosystem access guide to the doc

[ https://issues.apache.org/jira/browse/SPARK-48320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48320. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46634 [https:

[jira] [Assigned] (SPARK-48294) Make nestedTypeMissingElementTypeError case insensitive

[ https://issues.apache.org/jira/browse/SPARK-48294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48294: -- Assignee: Michael Zhang > Make nestedTypeMissingElementTypeError case insensitive > -

[jira] [Resolved] (SPARK-48294) Make nestedTypeMissingElementTypeError case insensitive

[ https://issues.apache.org/jira/browse/SPARK-48294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48294. Fix Version/s: 3.5.2 (was: 4.0.0) Resolution: Fixed Issue re

[jira] [Resolved] (SPARK-48303) Reorganize `LogKey`

[ https://issues.apache.org/jira/browse/SPARK-48303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48303. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46612 [https:

[jira] [Assigned] (SPARK-48303) Reorganize `LogKey`

[ https://issues.apache.org/jira/browse/SPARK-48303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48303: -- Assignee: BingKun Pan > Reorganize `LogKey` > --- > >

[jira] [Assigned] (SPARK-48214) Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory`

[ https://issues.apache.org/jira/browse/SPARK-48214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48214: -- Assignee: BingKun Pan > Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory` > -

[jira] [Resolved] (SPARK-48214) Ban import `org.slf4j.Logger` & `org.slf4j.LoggerFactory`

[ https://issues.apache.org/jira/browse/SPARK-48214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48214. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46502 [https:

[jira] [Resolved] (SPARK-48291) Rename Java Logger as SparkLogger

[ https://issues.apache.org/jira/browse/SPARK-48291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48291. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46600 [https:

[jira] [Updated] (SPARK-48291) Rename Java Logger as SparkLogger

[ https://issues.apache.org/jira/browse/SPARK-48291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48291: --- Summary: Rename Java Logger as SparkLogger (was: Refactor Java Logger as SparkLogger ) >

[jira] [Created] (SPARK-48291) Refactor Java Logger as SparkLogger

Gengliang Wang created SPARK-48291: -- Summary: Refactor Java Logger as SparkLogger Key: SPARK-48291 URL: https://issues.apache.org/jira/browse/SPARK-48291 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47599) MLLib: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47599. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46527 [https:

[jira] [Assigned] (SPARK-48209) Common (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48209: -- Assignee: BingKun Pan > Common (java side): Migrate `error/warn/info` with variables

[jira] [Resolved] (SPARK-48209) Common (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48209. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46493 [https:

[jira] [Assigned] (SPARK-48260) disable output committer coordination in one test of ParquetIOSuite

[ https://issues.apache.org/jira/browse/SPARK-48260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48260: -- Assignee: Gengliang Wang > disable output committer coordination in one test of Parqu

[jira] [Resolved] (SPARK-48260) disable output committer coordination in one test of ParquetIOSuite

[ https://issues.apache.org/jira/browse/SPARK-48260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48260. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46562 [https:

[jira] [Commented] (SPARK-47599) MLLib: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844869#comment-17844869 ] Gengliang Wang commented on SPARK-47599: I checked with [~itholic] and he is not

[jira] [Resolved] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48182. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46450 [https:

[jira] [Assigned] (SPARK-48182) SQL (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48182: -- Assignee: BingKun Pan > SQL (java side): Migrate `error/warn/info` with variables to

[jira] [Resolved] (SPARK-48126) Make spark.log.structuredLogging.enabled effective

[ https://issues.apache.org/jira/browse/SPARK-48126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48126. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46452 [https:

[jira] [Updated] (SPARK-48126) Make spark.log.structuredLogging.enabled effective

[ https://issues.apache.org/jira/browse/SPARK-48126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48126: --- Summary: Make spark.log.structuredLogging.enabled effective (was: Make spark.log.structured

[jira] [Resolved] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48134. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46390 [https:

[jira] [Assigned] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48134: -- Assignee: BingKun Pan > Spark core (java side): Migrate `error/warn/info` with variab

[jira] [Created] (SPARK-48145) Remove logDebug and logTrace with MDC in java structured logging framework

Gengliang Wang created SPARK-48145: -- Summary: Remove logDebug and logTrace with MDC in java structured logging framework Key: SPARK-48145 URL: https://issues.apache.org/jira/browse/SPARK-48145 Projec

[jira] [Created] (SPARK-48131) Unify MDC key `mdc.taskName` and `task_name`

Gengliang Wang created SPARK-48131: -- Summary: Unify MDC key `mdc.taskName` and `task_name` Key: SPARK-48131 URL: https://issues.apache.org/jira/browse/SPARK-48131 Project: Spark Issue Type:

[jira] [Created] (SPARK-48129) Provide a constant table schema in PySpark for querying structured logs

Gengliang Wang created SPARK-48129: -- Summary: Provide a constant table schema in PySpark for querying structured logs Key: SPARK-48129 URL: https://issues.apache.org/jira/browse/SPARK-48129 Project:

[jira] [Resolved] (SPARK-48123) Provide a constant table schema for querying structured logs

[ https://issues.apache.org/jira/browse/SPARK-48123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48123. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46375 [https:

[jira] [Resolved] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47578. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46309 [https:

[jira] [Updated] (SPARK-48124) Disable structured logging for Interpreter by default

[ https://issues.apache.org/jira/browse/SPARK-48124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48124: --- Description: Since there are plain text output from Interpreters(spark-shell/spark-sql/pysp

[jira] [Updated] (SPARK-48124) Disable structured logging for Interpreter by default

[ https://issues.apache.org/jira/browse/SPARK-48124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48124: --- Description: Since there are plain text output from Interpreters(spark-shell/spark-sql/pysp

[jira] [Created] (SPARK-48126) Make spark.log.structuredLogging.enabled effecitve

Gengliang Wang created SPARK-48126: -- Summary: Make spark.log.structuredLogging.enabled effecitve Key: SPARK-48126 URL: https://issues.apache.org/jira/browse/SPARK-48126 Project: Spark Issue

[jira] [Created] (SPARK-48124) Disable structured logging for Interpreter by default

Gengliang Wang created SPARK-48124: -- Summary: Disable structured logging for Interpreter by default Key: SPARK-48124 URL: https://issues.apache.org/jira/browse/SPARK-48124 Project: Spark Iss

[jira] [Assigned] (SPARK-48059) Implement the structured log framework on the java side

[ https://issues.apache.org/jira/browse/SPARK-48059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48059: -- Assignee: BingKun Pan > Implement the structured log framework on the java side > ---

[jira] [Resolved] (SPARK-48059) Implement the structured log framework on the java side

[ https://issues.apache.org/jira/browse/SPARK-48059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48059. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46301 [https:

[jira] [Created] (SPARK-48123) Provide a constant table schema for querying structured logs

Gengliang Wang created SPARK-48123: -- Summary: Provide a constant table schema for querying structured logs Key: SPARK-48123 URL: https://issues.apache.org/jira/browse/SPARK-48123 Project: Spark

[jira] [Updated] (SPARK-47671) Enable structured logging in log4j2.properties.template and update `configuration.md`

[ https://issues.apache.org/jira/browse/SPARK-47671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47671: --- Description: # rename the current log4j2.properties.template as log4j2.properties.pattern-l

[jira] [Resolved] (SPARK-48067) Fix Variant default columns for more complex default variants

[ https://issues.apache.org/jira/browse/SPARK-48067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48067. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46312 [https:

[jira] [Assigned] (SPARK-48067) Fix Variant default columns for more complex default variants

[ https://issues.apache.org/jira/browse/SPARK-48067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48067: -- Assignee: Richard Chen > Fix Variant default columns for more complex default variant

[jira] [Resolved] (SPARK-47585) SQL core: Migrate logInfo with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47585. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46264 [https:

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48016: --- Fix Version/s: 4.0.0 3.5.2 > Fix a bug in try_divide function when with d

[jira] [Resolved] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48016. Fix Version/s: 3.4.4 Resolution: Fixed Issue resolved by pull request 46289 [https:

[jira] [Commented] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842193#comment-17842193 ] Gengliang Wang commented on SPARK-48016: [~dongjoon] sure, I just moved it. > F

[jira] [Updated] (SPARK-48016) Fix a bug in try_divide function when with decimals

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48016: --- Parent Issue: SPARK-44111 (was: SPARK-35161) > Fix a bug in try_divide function when with d

[jira] [Created] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

Gengliang Wang created SPARK-48035: -- Summary: try_add/try_multiply should not be semantic equal to add/multiply Key: SPARK-48035 URL: https://issues.apache.org/jira/browse/SPARK-48035 Project: Spark

[jira] [Updated] (SPARK-48016) Binary Arithmetic operators should include the evalMode when makeCopy

[ https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48016: --- Summary: Binary Arithmetic operators should include the evalMode when makeCopy (was: Binary

[jira] [Created] (SPARK-48016) Binary Arithmetic operators should include the evalMode during makeCopy

Gengliang Wang created SPARK-48016: -- Summary: Binary Arithmetic operators should include the evalMode during makeCopy Key: SPARK-48016 URL: https://issues.apache.org/jira/browse/SPARK-48016 Project:

[jira] [Resolved] (SPARK-47696) try_to_timestamp should handle SparkUpgradeException

[ https://issues.apache.org/jira/browse/SPARK-47696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47696. Resolution: Won't Fix > try_to_timestamp should handle SparkUpgradeException > ---

[jira] [Created] (SPARK-48011) Store LogKey name as a value to avoid generating new string instances

Gengliang Wang created SPARK-48011: -- Summary: Store LogKey name as a value to avoid generating new string instances Key: SPARK-48011 URL: https://issues.apache.org/jira/browse/SPARK-48011 Project: Sp

[jira] [Resolved] (SPARK-47963) Make the external Spark ecosystem can use structured logging mechanisms

[ https://issues.apache.org/jira/browse/SPARK-47963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47963. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46193 [https:

  1   2   3   4   5   6   7   8   9   10   >