Messages by Thread
-
[jira] [Updated] (SPARK-55167) Bug in Constraints code where dual use of IsNull and EqualsNullSafe( X, null), causes a conflict between PushDownPredicates and InferNewFiltersFrom Constraint, causing loss of idempotency achievement
Asif (Jira)
-
[jira] [Created] (SPARK-55167) Bug in Constraints code where dual use of IsNull and EqualsNullSafe( null), causes a conflict between PushDownPredicates and InferNewFiltersFrom Constraint, causing loss of idempotency achievement
Asif (Jira)
-
[jira] [Assigned] (SPARK-55134) If the executor’s resource request is greater than its limit, the driver is expected to exit.
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-55134) If the executor’s resource request is greater than its limit, the driver is expected to exit.
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-55165) Upgrade `kubernetes-client` to 7.5.2
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-55166) Upgrade `kubernetes-client` to 7.5.2
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-55165) Upgrade `kubernetes-client` to 7.5.2
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-55166) Upgrade `kubernetes-client` to 7.5.2
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55166) Upgrade `kubernetes-client` to 7.5.2
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-55165) Upgrade `kubernetes-client` to 7.5.2
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55165) Upgrade `kubernetes-client` to 7.5.2
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-49634) Remove the ANSI config suggestion in NUMERIC_VALUE_OUT_OF_RANGE.WITH_SUGGESTION
Sergei Repnikov (Jira)
-
[jira] [Updated] (SPARK-55134) If the executor’s resource request is greater than its limit, the driver is expected to exit.
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-55164) Refactor tests for python udf input type coercion
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55164) Refactor tests for python udf input type coercion
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55149) Upgrade python to 3.12 in SQL tests
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-55149) Upgrade python to 3.12 in SQL tests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-55163) SPIP: Client-Side Metadata Caching for Spark Connect
vaquar khan (Jira)
-
[jira] [Created] (SPARK-55163) SPIP: Client-Side Metadata Caching for Spark Connect
vaquar khan (Jira)
-
[jira] [Updated] (SPARK-55162) Extract transformers from ArrowStreamUDFSerializer
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55162) Extract transformers from ArrowStreamUDFSerializer
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-55161) Support profilers on python data source
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-55111) Failed repartitioning detection on query restart
Anish Shrigondekar (Jira)
-
[jira] [Assigned] (SPARK-55111) Failed repartitioning detection on query restart
Anish Shrigondekar (Jira)
-
[jira] [Updated] (SPARK-55159) Extract Arrow batch transformers from serializers for better composability
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-55160) Directly pass input schema to serializers
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55161) Support profilers on python data source
Tian Gao (Jira)
-
[jira] [Created] (SPARK-55160) Directly pass input schema to serializers
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-55159) Extract Arrow batch transformers from serializers for better composability
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-55158) infer_return_type for str should be the dedicated string dtype
Tian Gao (Jira)
-
[jira] [Created] (SPARK-55158) infer_return_types for str should be the dedicated string dtype
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-54996) Report ArrivalTime for records from LowLatencyMemoryStream
Jungtaek Lim (Jira)
-
[jira] [Assigned] (SPARK-54996) Report ArrivalTime for records from LowLatencyMemoryStream
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-55157) Replace classutil with ClassGraph in GenerateMIMAIgnore tool
Fangchen Li (Jira)
-
[jira] [Created] (SPARK-55157) Replace classutil with ClassGraph in GenerateMIMAIgnore tool
Fangchen Li (Jira)
-
[jira] [Created] (SPARK-55156) deal with include_groups for groupby.apply
Tian Gao (Jira)
-
[jira] [Assigned] (SPARK-55046) Emit granular UDF processing time metric
Takuya Ueshin (Jira)
-
[jira] [Resolved] (SPARK-55046) Emit granular UDF processing time metric
Takuya Ueshin (Jira)
-
[jira] [Updated] (SPARK-55155) Support foldable expression for SET CATALOG
Yuyuan Tang (Jira)
-
[jira] [Created] (SPARK-55155) Support foldable expression for SET CATALOG
Yuyuan Tang (Jira)
-
[jira] [Updated] (SPARK-55154) Remove fastpath to pd.Series
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55154) Remove fastpath to pd.Series
Tian Gao (Jira)
-
[jira] [Updated] (SPARK-55153) Add documentation for TwsTester
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55153) Add documentation for TwsTester
Dmytro Fedoriaka (Jira)
-
[jira] [Created] (SPARK-55152) Evaluate serialization strategy for Scala 3 support
Fangchen Li (Jira)
-
[jira] [Updated] (SPARK-55151) Fix streaming RocksDBSuite testWithStateStoreCheckpointIds
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55151) Fix streaming RocksDBSuite testWithStateStoreCheckpointIds
Zifei Feng (Jira)
-
[jira] [Updated] (SPARK-55150) Improve ObservationManager.tryComplete error handling
Yihong He (Jira)
-
[jira] [Resolved] (SPARK-55140) Do not convert builtin functions for pandas 3 anymore
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55140) Do not convert builtin functions for pandas 3 anymore
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55132) Upgrade numpy version on lint image
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55132) Upgrade numpy version on lint image
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-55150) Improve observation error handling
Yihong He (Jira)
-
[jira] [Updated] (SPARK-55150) Defer throwing observation errors
Yihong He (Jira)
-
[jira] [Created] (SPARK-55150) Throw observation errors
Yihong He (Jira)
-
[jira] [Assigned] (SPARK-55138) Fix convertToMapData throwing a NullPointerException
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-55138) Fix convertToMapData throwing a NullPointerException
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-55137) Refactor GroupingAnalyticsTransformer and Analyzer code
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-55137) Refactor GroupingAnalyticsTransformer and Analyzer code
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-53015) Upgrade log4j2 to 2.25.3
Kousuke Saruta (Jira)
-
[jira] [Resolved] (SPARK-55115) Use master branch's Dockerfile for release builds
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-55115) Use master branch's Dockerfile for release builds
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-54150) Support Scala 3.x
Fangchen Li (Jira)
-
[jira] [Updated] (SPARK-55149) Upgrade python to 3.12 in SQL tests
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55149) Upgrade python to 3.12 in SQL tests
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55142) Apply Python 3.12 in PR build
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55142) Apply Python 3.12 in PR build
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-55148) Improving performance in state format in stream-stream join via RocksDB batch operations (WriteBatch, MGET, etc)
Jungtaek Lim (Jira)
-
[jira] [Created] (SPARK-55147) Improve the retrieval operation in new stream-stream stateful operator to scope the timestamp range for time-interval join
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-55146) State repartition pyspark API
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55146) State repartition pyspark API
B. Micheal Okutubo (Jira)
-
[jira] [Created] (SPARK-55145) Reflect the new RocksDB key encoders in SPARK-55129 to Avro
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-55144) Introduce new state format version for performant stream-stream join
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55144) Introduce new state format version for performant stream-stream join
Jungtaek Lim (Jira)
-
[jira] [Resolved] (SPARK-55141) Set up a scheduled builder for Pandas 3
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55141) Set up a scheduled builder for Pandas 3
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-55143) Drop Python 3.10
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55143) Drop Python 3.10
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-55142) Apply Python 3.12 in PR build
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55142) Apply Python 3.12 in PR build
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-55141) Set up a scheduled builder for Pandas 3
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55141) Set up a scheduled builder for Pandas 3
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55135) Refactor tests for pandas udf return type coercion
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55135) Refactor tests for pandas udf return type coercion
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-55140) Do not convert builtin functions for pandas 3 anymore
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55140) Do not convert builtin functions for pandas 3 anymore
Tian Gao (Jira)
-
[jira] [Created] (SPARK-55139) Support Pandas 3
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-55125) Remove redundant __init__ methods in Arrow serializers
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55125) Remove redundant __init__ methods in Arrow serializers
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55021) Introduce SparkTestSuite as the base class for all scala tests
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55021) Introduce SparkTestSuite as the base class for all scala tests
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-54965) Factor out legacy pa.Array -> pd.Series (np-backed) converter
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-55037) Re-implement Observation Without Using the QueryExecutionListener
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-55135) Refactor tests for pandas udf return type coercion
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-54314) Improve Server-Side debuggability in Spark Connect by capturing client application's file name and line numbers in PySpark
Huaxin Gao (Jira)
-
[jira] [Assigned] (SPARK-55127) [SQL] Add avro_funcs group for Avro SQL functions
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-55127) [SQL] Add avro_funcs group for Avro SQL functions
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-54965) Factor out legacy pa.Array -> pd.Series (np-backed) converter
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-55037) Re-implement Observation Without Using the QueryExecutionListener
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-55138) Fix convertToMapData throwing a NullPointerException
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55138) Fix convertToMapData throwing a NullPointerException
Marko Ilic (Jira)
-
[jira] [Updated] (SPARK-55137) Refactor GroupingAnalyticsTransformer and Analyzer code
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55137) Refactor GroupingAnalyticsTransformer and Analyzer code
Mihailo Aleksic (Jira)
-
[jira] [Updated] (SPARK-55136) Bump Db2 JDBC driver to 12.1.3.0_special_74723
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55136) Bump Db2 JDBC driver to 12.1.3.0_special_74723
Cheng Pan (Jira)
-
[jira] [Updated] (SPARK-55131) The default delimiter of StringAppendOperator (merge operator for RocksDB) conflicts when merge is used with non-existence value
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-54965) Factor out legacy pa.Array -> pd.Series (np-backed) converter
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55135) Refactor tests for pandas udf return type coercion
Ruifeng Zheng (Jira)
-
[jira] [Commented] (SPARK-55134) If the executor’s resource request is greater than its limit, the driver is expected to exit.
Wenjun Ruan (Jira)
-
[jira] [Created] (SPARK-55134) If the executor’s resource request is greater than its limit, the driver is expected to exit.
Wenjun Ruan (Jira)
-
[jira] [Resolved] (SPARK-55130) Upgrade log4j2 to 2.25.3
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-55130) Upgrade log4j2 to 2.25.3
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-55126) Remove unused timezone and assign_cols_by_name from ArrowStreamArrowUDFSerializer
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55126) Remove unused timezone and assign_cols_by_name from ArrowStreamArrowUDFSerializer
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55124) Move `test_spark_arrow_c_streamer_arrow_consumer` to PS and also enable the connect parity test
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55124) Move `test_spark_arrow_c_streamer_arrow_consumer` to PS and also enable the connect parity test
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55113) EnsureRequirements should copy tags
Peter Toth (Jira)
-
[jira] [Assigned] (SPARK-55113) EnsureRequirements should copy tags
Peter Toth (Jira)
-
[jira] [Resolved] (SPARK-55128) Restore SQL tests by pin 'pandas<3'
Ruifeng Zheng (Jira)
-
[jira] [Commented] (SPARK-54943) Add tests for pa.Array.cast with overflow
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-55133) Fix race condition in IsolatedSessionState lifecycle management
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55133) Fix race condition in IsolatedSessionState lifecycle management
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-55132) Upgrade numpy version on lint image
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55132) Upgrade numpy version on lint image
Tian Gao (Jira)
-
[jira] [Created] (SPARK-55131) The default delimiter of StringAppendOperator (merge operator for RocksDB) conflicts when merge is used with non-existence value
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-55130) Upgrade log4j2 to 2.25.3
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-55129) Introduce State Store API and key encoders for event-time as a first class
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55130) Upgrade log4j2 to 2.25.3
Yang Jie (Jira)
-
[jira] [Created] (SPARK-55129) Introduce State Store API and key encoders for event-time as a first class
Jungtaek Lim (Jira)
-
[jira] [Resolved] (SPARK-55112) Add micro-benchmark for Spark's BloomFilter
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-55112) Add micro-benchmark for Spark's BloomFilter
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-55127) [SQL] Add avro_funcs group for Avro SQL functions
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-55128) Restore SQL tests by pin 'pandas<3'
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55128) Restore SQL tests by pin 'pandas<3'
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-55127) [SQL] Add avro_funcs group for Avro SQL functions
Kent Yao (Jira)
-
[jira] [Assigned] (SPARK-55116) Upgrade Jackson to 2.21.0
Yang Jie (Jira)
-
[jira] [Resolved] (SPARK-55116) Upgrade Jackson to 2.21.0
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-55116) Upgrade Jackson to 2.21.0
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-55119) CONTINUE handler should not interrupt conditional if exception thrown by previous statement
Milan Dankovic (Jira)
-
[jira] [Updated] (SPARK-55119) CONTINUE handler should not interrupt conditional if exception thrown by previous statement
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-55126) Remove unused timezone and assign_cols_by_name from ArrowStreamArrowUDFSerializer
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55126) Remove unused timezone and assign_cols_by_name from ArrowStreamArrowUDFSerializer
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-55125) Remove redundant __init__ methods in Arrow serializers
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-54942) Add tests for pa.Array.cast with default arguments
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-54942) Add tests for pa.Array.cast with default arguments
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-55125) Remove redundant __init__ methods in Arrow serializers
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-55124) Move `test_spark_arrow_c_streamer_arrow_consumer` to PS and also enable the connect parity test
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55124) Move `test_spark_arrow_c_streamer_arrow_consumer` to PS and also enable the connect parity test
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55114) Refactor tests for python udf return type coercion
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-55114) Refactor tests for python udf return type coercion
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-55040) Refactor how TaskContext is passed
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-55040) Refactor how TaskContext is passed
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-55074) Add test for Merge Into ANSI type coercion
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-55074) Add test for Merge Into ANSI type coercion
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-55017) SPIP: Migrate from JIRA to Github issues
Tian Gao (Jira)
-
[jira] [Created] (SPARK-55123) Add SequentialUnionOffset for tracking sequential source processing
Eric Marnadi (Jira)
-
[jira] [Created] (SPARK-55122) Allow seamless and sequential source switching for streaming queries
Eric Marnadi (Jira)
-
[jira] [Updated] (SPARK-55121) Add DataStreamReader.name() to Classic PySpark
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-54217) PythonRunner does not synchronize Python worker kill/release decisions
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-54217) PythonRunner does not synchronize Python worker kill/release decisions
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-55106) Test repartition for TransformWithState
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55121) Add DataStreamReader.name() to Classic PySpark
Eric Marnadi (Jira)
-
[jira] [Updated] (SPARK-55120) Embedding spark-submit
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-55120) Embedding spark-submit
Vincent Janelle (Jira)
-
[jira] [Created] (SPARK-55119) CONTINUE handler should not interrupt conditional if exception thrown by previous statement
Milan Dankovic (Jira)
-
[jira] [Updated] (SPARK-55109) RaiseError(xyz).sql is broken in 4.0
Felipe (Jira)
-
[jira] [Updated] (SPARK-55118) Replace ASM Opcodes wildcard imports
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-54914) Pipe Syntax - Qualified Column Names in DROP Operator
Daniel Tenedorio (Jira)