Messages by Thread
-
-
[jira] [Assigned] (SPARK-48003) Hll sketch aggregate support for strings with collation
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-48005) Enable `DefaultIndexParityTests. test_index_distributed_sequence_cleanup`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-48005) Enable `DefaultIndexParityTests. test_index_distributed_sequence_cleanup`
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-48003) Hll sketch aggregate support for strings with collation
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47993) Drop Python 3.8 support
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-48004) Add WriteFilesExecBase trait for v1 write
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-48004) Add WriteFilesExecBase trait for v1 write
XiDuo You (Jira)
-
[jira] [Created] (SPARK-48003) Hll sketch aggregate support for strings with collation
Jira
-
[jira] [Resolved] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`
Kent Yao (Jira)
-
[jira] [Assigned] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`
Kent Yao (Jira)
-
[jira] [Updated] (SPARK-47968) MsSQLServer: Map datatimeoffset to TimestampType
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47986) [CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-48002) Add Observed metrics test in PySpark StreamingQueryListeners
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-48002) Add Observed metrics test in PySpark StreamingQueryListeners
Wei Liu (Jira)
-
[jira] [Created] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`
Yang Jie (Jira)
-
[jira] [Resolved] (SPARK-47922) Implement try_parse_json
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison
Kent Yao (Jira)
-
[jira] [Resolved] (SPARK-47978) Decouple Spark Go Connect Library versioning from Spark versioning
BoYang (Jira)
-
[jira] [Updated] (SPARK-45225) XML: XSD file URL support
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47991) Arrange the test cases for window frames and window functions.
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-48000) Hash join support for strings with collation
Jira
-
[jira] [Commented] (SPARK-22231) Support of map, filter, withField, dropFields in nested list of structures
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-22231) Support of map, filter, withField, dropFields in nested list of structures
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-24941) Add RDDBarrier.coalesce() function
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-25383) Image data source supports sample pushdown
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-25752) Add trait to easily whitelist logical operators that produce named output from CleanupAliases
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-28629) Capture the missing rules in HiveSessionStateBuilder
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-28629) Capture the missing rules in HiveSessionStateBuilder
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-30324) Simplify API for JSON access in DataFrames/SQL
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-30324) Simplify API for JSON access in DataFrames/SQL
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-30334) Add metadata around semi-structured columns to Spark
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-30334) Add metadata around semi-structured columns to Spark
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-24942) Improve cluster resource management with jobs containing barrier stage
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-47998) pandas-on-spark DataFrame.concat will not join a Pandas dataframe and raises a misleading error
Philip Kahn (Jira)
-
[jira] [Updated] (SPARK-24942) Improve cluster resource management with jobs containing barrier stage
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-47997) Pandas-on-Spark incompletely implements DataFrame.drop
Philip Kahn (Jira)
-
[jira] [Created] (SPARK-47996) Pandas-on-Spark incompletely implements merge methods
Philip Kahn (Jira)
-
[jira] [Created] (SPARK-47994) SQLServer does not support 1 and 0 as boolean values
Stefan Bukorovic (Jira)
-
[jira] [Updated] (SPARK-47355) Use wildcard imports in CollationTypeCast
Jira
-
[jira] [Updated] (SPARK-47355) Use wildcard imports in CollationTypeCasts
Jira
-
[jira] [Resolved] (SPARK-47987) Enable `ArrowParityTests.test_createDataFrame_empty_partition`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47990) Upgrade `zstd-jni` to 1.5.6-3
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-46830) Introducing collation concept into Spark
Gideon P (Jira)
-
[jira] [Commented] (SPARK-44111) Prepare Apache Spark 4.0.0
Florent BIVILLE (Jira)
-
[jira] [Resolved] (SPARK-47985) Simplify functions with `lit`
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-47985) Simplify functions with `lit`
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-47993) Drop Python 3.8 support
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47963) Make the external Spark ecosystem can use structured logging mechanisms
BingKun Pan (Jira)
-
[jira] [Created] (SPARK-47992) Support recursive descent path in get_json_object function
Qian Sun (Jira)
-
[jira] [Updated] (SPARK-47991) Arrange the test cases for window frames and window functions.
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47991) Arrange the test cases for window frames and window functions.
Jiaan Geng (Jira)
-
[jira] [Commented] (SPARK-38958) Override S3 Client in Spark Write/Read calls
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47297) TBD
Jira
-
[jira] [Updated] (SPARK-47408) Fix mathExpressions that use StringType
Mihailo Milosevic (Jira)
-
[jira] [Commented] (SPARK-47353) Mode (all collations)
Jira
-
[jira] [Updated] (SPARK-47623) Enable `QuietTest` in parity tests
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-47982) Update code style' plugins to latest version
Kent Yao (Jira)
-
[jira] [Updated] (SPARK-47986) [CONNECT][PYTHON] Unable to create a new session when the default session is closed by the server
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47987) Reenable `ArrowParityTests.test_createDataFrame_empty_partition`
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.
Kent Yao (Jira)
-
[jira] [Assigned] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.
Kent Yao (Jira)
-
[jira] [Updated] (SPARK-47970) Revisit skipped parity tests for PySpark Connect
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-47983) Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal
Kent Yao (Jira)
-
[jira] [Updated] (SPARK-47985) Simplify functions with `lit`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47985) Simplify functions with `lit`
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-47983) Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47983) Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal
Kent Yao (Jira)
-
[jira] [Created] (SPARK-47982) Update code style' plugins to latest version
BingKun Pan (Jira)
-
[jira] [Commented] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default
Dongjoon Hyun (Jira)
-
[jira] [Closed] (SPARK-44304) Broadcast operation is not required when no parameters are specified
7mming7 (Jira)
-
[jira] [Updated] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to `false` by default
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-46122) Set `spark.sql.legacy.createHiveTableByDefault` to false by default
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47962) Improve doc test in pyspark dataframe
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47979) Use Hive tables explicitly for Hive table capability tests
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47921) Fix ExecuteJobTag creation in ExecuteHolder
Takuya Ueshin (Jira)
-
[jira] [Created] (SPARK-47979) Use Hive table explicitly for Hive table capability tests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47979) Use Hive tables explicitly for Hive table capability tests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47977) DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47977) DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception
Vitalii Li (Jira)
-
[jira] [Resolved] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework
Gengliang Wang (Jira)
-
[jira] [Updated] (SPARK-47939) Parameterized queries fail for DESCRIBE & EXPLAIN w/ UNBOUND_SQL_PARAMETER error
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-45265) Support Hive 4.0 metastore
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-44677) Drop legacy Hive-based ORC file format
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-47499) Reuse `test_help_command` in Connect
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47633) Cache miss for queries using JOIN LATERAL with join condition
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47633) Cache miss for queries using JOIN LATERAL with join condition
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47974) Remove install_scala from build/mvn
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47958) Task Scheduler may not know about executor when using LocalSchedulerBackend
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47974) Remove install_scala from build/mvn
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47974) Remove install_scala from build/mvn
Cheng Pan (Jira)
-
[jira] [Updated] (SPARK-47961) CREATE TABLE AS SELECT changes behaviour in SPARK 3.4.0
Eugen Stoianovici (Jira)
-
[jira] [Updated] (SPARK-47962) Improve doc test in pyspark dataframe
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-47418) Optimize string predicate expressions for UTF8_BINARY_LCASE collation
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-47972) Restrict CAST expression for collations
Mihailo Milosevic (Jira)
-
[jira] [Resolved] (SPARK-47964) Hide SQLContext and HiveContext
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47499) Reuse `test_help_command` in Connect
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-47970) Revisit skipped parity tests for PySpark
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-47969) Make `test_creation_index` deterministic
Dongjoon Hyun (Jira)
-
[jira] [Comment Edited] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user
Shawn Lavelle (Jira)
-
[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder and OptionalConfigEntry
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-47965) Avoid orNull in TypedConfigBuilder
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47965) Avoid orNull in TypedConfigBuilder
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47946) Nested field's nullable value could be invalid after extracted using GetStructField
Junyoung Cho (Jira)
-
[jira] [Comment Edited] (SPARK-47597) Streaming: Migrate logInfo with variables to structured logging framework
Daniel (Jira)
-
[jira] [Commented] (SPARK-47597) Streaming: Migrate logInfo with variables to structured logging framework
Daniel (Jira)
-
[jira] [Resolved] (SPARK-47604) Resource managers: Migrate logInfo with variables to structured logging framework
Gengliang Wang (Jira)
-
[jira] [Updated] (SPARK-47960) Support Chaining Stateful Operators in TransformWithState
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47961) CREATE TABLE AS SELECT changes behaviour in SPARK 3.4.0
Eugen Stoianovici (Jira)
-
[jira] [Created] (SPARK-47960) Support Chaining Stateful Operators in TransformWithState
Bhuwan Sahni (Jira)
-
[jira] [Updated] (SPARK-47959) Improve GET_JSON_OBJECT performance on executors running multiple tasks
Zheng Shao (Jira)
-
[jira] [Created] (SPARK-47959) Improve GET_JSON_OBJECT performance on executors running multiple tasks
Zheng Shao (Jira)
-
[jira] [Updated] (SPARK-47958) Task Scheduler may not know about executor when using LocalSchedulerBackend
Davin Tjong (Jira)
-
[jira] [Created] (SPARK-47958) Task Scheduler may not know about executor when using LocalSchedulerBackend
Davin Tjong (Jira)
-
[jira] [Resolved] (SPARK-47956) sanity check for unresolved LCA reference
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47956) sanity check for unresolved LCA reference
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47948) Upgrade the minimum Pandas version to 2.0.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47948) Upgrade the minimum Pandas version to 2.0.0
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47957) pyspark.pandas.read_excel can't get _metadata because it causes a "max iterations reached for batch Resolution" error
Christos Karras (Jira)
-
[jira] [Updated] (SPARK-47948) Upgrade the minimum Pandas version to 2.0.0
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-47957) pyspark.pandas.read_excel can't get _metadata because it causes a "max iterations reached for batch Resolution" error
Christos Karras (Jira)
-
[jira] [Resolved] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47953) MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47953) MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47873) Write collated strings to hive as regular strings
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-47956) sanity check for unresolved LCA reference
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47956) sanity check for unresolved LCA reference
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-47954) Support creating ingress entry for external UI access
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47954) Support creating ingress entry for external UI access
Cheng Pan (Jira)
-
[jira] [Resolved] (SPARK-47352) Fix Upper, Lower, InitCap collation awareness
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-46841) Language support for collations
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47805) [Arbitrary State Support] State TTL support - MapState
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-47952) Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn
TakawaAkirayo (Jira)
-
[jira] [Updated] (SPARK-47953) MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47953) MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server
Kent Yao (Jira)
-
[jira] [Created] (SPARK-47952) Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn
TakawaAkirayo (Jira)
-
[jira] [Commented] (SPARK-47952) Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn
TakawaAkirayo (Jira)
-
[jira] [Updated] (SPARK-47950) Add Java API Module for Spark Operator
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47951) Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn
TakawaAkirayo (Jira)
-
[jira] [Resolved] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests
Kent Yao (Jira)
-
[jira] [Assigned] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests
Kent Yao (Jira)
-
[jira] [Updated] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47950) Add Java API Module for Spark Operator
Zhou JIANG (Jira)
-
[jira] [Updated] (SPARK-47948) Bump Pandas to 2.0.0
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04
Kent Yao (Jira)
-
[jira] [Created] (SPARK-47948) Bump Pandas to 2.0.0
Haejoon Lee (Jira)
-
[jira] [Resolved] (SPARK-47412) StringLPad, StringRPad (all collations)
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-47412) StringLPad, StringRPad (all collations)
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-47947) Add AssertDataFrameEquality util function for scala
Anh Tuan Pham (Jira)
-
[jira] [Assigned] (SPARK-47943) Add Operator CI Task for Java Build and Test
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47943) Add Operator CI Task for Java Build and Test
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47929) Setup Static Analysis for Operator
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47938) MsSQLServer: Cannot find data type BYTE error
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47600) MLLib: Migrate logInfo with variables to structured logging framework
Gengliang Wang (Jira)
-
[jira] [Assigned] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-47946) Nested field's nullable value could be invalid after extracted using GetStructField
Junyoung Cho (Jira)
-
[jira] [Updated] (SPARK-47943) Add Operator CI Task for Java Build and Test
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests
ASF GitHub Bot (Jira)