[
https://issues.apache.org/jira/browse/SPARK-47408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47408.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46227
[
https://issues.apache.org/jira/browse/SPARK-48019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gene Pang updated SPARK-48019:
--
Description:
{{ColumnVectors}} have APIs like {{getInts}}, {{getFloats}} and so on. Those
return a
Gene Pang created SPARK-48019:
-
Summary: ColumnVectors with dictionaries and nulls are not
read/copied correctly
Key: SPARK-48019
URL: https://issues.apache.org/jira/browse/SPARK-48019
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-48018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-48018:
Assignee: B. Micheal Okutubo
> Null groupId causing missing param error when throwing
>
[
https://issues.apache.org/jira/browse/SPARK-48018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-48018.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46253
[
https://issues.apache.org/jira/browse/SPARK-48017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48017:
---
Labels: pull-request-available (was: )
> Add Spark application submission worker for
[
https://issues.apache.org/jira/browse/SPARK-48018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
B. Micheal Okutubo updated SPARK-48018:
---
Description:
[INTERNAL_ERROR] Undefined error message parameter for error class:
[
https://issues.apache.org/jira/browse/SPARK-48018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48018:
---
Labels: pull-request-available (was: )
> Null groupId causing missing param error when
B. Micheal Okutubo created SPARK-48018:
--
Summary: Null groupId causing missing param error when throwing
KafkaException.couldNotReadOffsetRange
Key: SPARK-48018
URL:
Zhou JIANG created SPARK-48017:
--
Summary: Add Spark application submission worker for operator
Key: SPARK-48017
URL: https://issues.apache.org/jira/browse/SPARK-48017
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48016:
---
Labels: pull-request-available (was: )
> Binary Arithmetic operators should include the
[
https://issues.apache.org/jira/browse/SPARK-48016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang updated SPARK-48016:
---
Summary: Binary Arithmetic operators should include the evalMode when
makeCopy (was:
Gengliang Wang created SPARK-48016:
--
Summary: Binary Arithmetic operators should include the evalMode
during makeCopy
Key: SPARK-48016
URL: https://issues.apache.org/jira/browse/SPARK-48016
Project:
[
https://issues.apache.org/jira/browse/SPARK-47696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-47696.
Resolution: Won't Fix
> try_to_timestamp should handle SparkUpgradeException
>
[
https://issues.apache.org/jira/browse/SPARK-47943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47943:
--
Fix Version/s: kubernetes-operator-0.1.0
(was: 4.0.0)
> Add Operator
[
https://issues.apache.org/jira/browse/SPARK-48015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-48015:
-
Assignee: Dongjoon Hyun
> Update `build.gradle` to fix deprecation warnings
>
[
https://issues.apache.org/jira/browse/SPARK-48015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-48015.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 9
[
https://issues.apache.org/jira/browse/SPARK-47929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47929:
--
Fix Version/s: kubernetes-operator-0.1.0
(was: 4.0.0)
> Setup Static
[
https://issues.apache.org/jira/browse/SPARK-47950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47950:
--
Fix Version/s: kubernetes-operator-0.1.0
(was: 4.0.0)
> Add Java API
[
https://issues.apache.org/jira/browse/SPARK-48015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-48015:
--
Fix Version/s: kubernetes-operator-0.1.0
(was: 4.0.0)
> Update
[
https://issues.apache.org/jira/browse/SPARK-48015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48015:
---
Labels: pull-request-available (was: )
> Update `build.gradle` to fix deprecation warnings
Dongjoon Hyun created SPARK-48015:
-
Summary: Update `build.gradle` to fix deprecation warnings
Key: SPARK-48015
URL: https://issues.apache.org/jira/browse/SPARK-48015
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-47950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47950:
-
Assignee: Zhou JIANG
> Add Java API Module for Spark Operator
>
[
https://issues.apache.org/jira/browse/SPARK-47950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47950.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 8
[
https://issues.apache.org/jira/browse/SPARK-48014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48014:
---
Labels: pull-request-available (was: )
> Change the makeFromJava error in EvaluatePython
Allison Wang created SPARK-48014:
Summary: Change the makeFromJava error in EvaluatePython to a
user-facing error
Key: SPARK-48014
URL: https://issues.apache.org/jira/browse/SPARK-48014
Project:
[
https://issues.apache.org/jira/browse/SPARK-47959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841355#comment-17841355
]
Tatu Saloranta commented on SPARK-47959:
Aside from question of reducing contention in
[
https://issues.apache.org/jira/browse/SPARK-47219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841353#comment-17841353
]
Sandip Agarwala commented on SPARK-47219:
-
Correct. Thanks for pointing it out. I closed it as
[
https://issues.apache.org/jira/browse/SPARK-47219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandip Agarwala resolved SPARK-47219.
-
Resolution: Duplicate
> XML: Ignore commented row tags in XML tokenizer
>
[
https://issues.apache.org/jira/browse/SPARK-47219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841351#comment-17841351
]
HiuFung Kwok commented on SPARK-47219:
--
[~sandip.agarwala] Do we need this task, it seems to be
[
https://issues.apache.org/jira/browse/SPARK-42846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841347#comment-17841347
]
HiuFung Kwok commented on SPARK-42846:
--
Hi [~maxgekk] , I have submitted an MR for this, would you
[
https://issues.apache.org/jira/browse/SPARK-48012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-48012:
--
Parent: SPARK-37375
Issue Type: Sub-task (was: New Feature)
> SPJ: Support Transfrom
Szehon Ho created SPARK-48012:
-
Summary: SPJ: Support Transfrom Expressions for One Side Shuffle
Key: SPARK-48012
URL: https://issues.apache.org/jira/browse/SPARK-48012
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-47959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841339#comment-17841339
]
PJ Fanning commented on SPARK-47959:
[~zshao] if you have a test environment, could you try it with
[
https://issues.apache.org/jira/browse/SPARK-48010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-48010.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46248
Gengliang Wang created SPARK-48011:
--
Summary: Store LogKey name as a value to avoid generating new
string instances
Key: SPARK-48011
URL: https://issues.apache.org/jira/browse/SPARK-48011
Project:
[
https://issues.apache.org/jira/browse/SPARK-47963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-47963.
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46193
[
https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-46122:
-
Assignee: Dongjoon Hyun
> Set `spark.sql.legacy.createHiveTableByDefault` to `false`
[
https://issues.apache.org/jira/browse/SPARK-48005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-48005.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46242
[
https://issues.apache.org/jira/browse/SPARK-48010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48010:
---
Labels: pull-request-available (was: )
> Avoid repeated calls to conf.resolver in
Nikhil Sheoran created SPARK-48010:
--
Summary: Avoid repeated calls to conf.resolver in resolveExpression
Key: SPARK-48010
URL: https://issues.apache.org/jira/browse/SPARK-48010
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zheng Shao updated SPARK-47959:
---
Description:
We have a Spark executor that is running 32 workers in parallel. The query is
a
[
https://issues.apache.org/jira/browse/SPARK-47968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-47968.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46239
[
https://issues.apache.org/jira/browse/SPARK-47476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47476:
---
Assignee: Uroš Bojanić
> StringReplace (all collations)
> --
>
[
https://issues.apache.org/jira/browse/SPARK-47476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47476.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45704
[
https://issues.apache.org/jira/browse/SPARK-48007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-48007.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46244
[
https://issues.apache.org/jira/browse/SPARK-30709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen deleted SPARK-30709:
-
> Spark 2.3 to Spark 2.4 Upgrade. Problems reading HIVE partitioned tables.
>
[
https://issues.apache.org/jira/browse/SPARK-48009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841216#comment-17841216
]
Rushikesh Kavar commented on SPARK-48009:
-
I am calling OverrideAvro first and then AppendAvro
[
https://issues.apache.org/jira/browse/SPARK-48009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841214#comment-17841214
]
Rushikesh Kavar commented on SPARK-48009:
-
import org.apache.spark.sql.*;
import
[
https://issues.apache.org/jira/browse/SPARK-48009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841213#comment-17841213
]
Rushikesh Kavar commented on SPARK-48009:
-
import org.apache.spark.sql.SaveMode;
import
[
https://issues.apache.org/jira/browse/SPARK-48009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841211#comment-17841211
]
Rushikesh Kavar commented on SPARK-48009:
-
import org.apache.spark.sql.SaveMode;
import
[
https://issues.apache.org/jira/browse/SPARK-48009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841212#comment-17841212
]
Rushikesh Kavar commented on SPARK-48009:
-
public class Modal {
public String id;
[
https://issues.apache.org/jira/browse/SPARK-48009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841210#comment-17841210
]
Rushikesh Kavar commented on SPARK-48009:
-
I will attach the code within few hours
>
Rushikesh Kavar created SPARK-48009:
---
Summary: Specifications for Apache Spark hadoop Avro append
operation
Key: SPARK-48009
URL: https://issues.apache.org/jira/browse/SPARK-48009
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47351.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46165
[
https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-47351:
---
Assignee: Uroš Bojanić
> StringToMap & Mask (all collations)
>
[
https://issues.apache.org/jira/browse/SPARK-47350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47350.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46158
[
https://issues.apache.org/jira/browse/SPARK-47408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47408:
---
Labels: pull-request-available (was: )
> Fix mathExpressions that use StringType
>
[
https://issues.apache.org/jira/browse/SPARK-48008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengfei Xu updated SPARK-48008:
---
Description:
Currently Spark Connect supports only UDFs. We need to add support for UDAFs,
[
https://issues.apache.org/jira/browse/SPARK-48004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-48004:
Assignee: XiDuo You
> Add WriteFilesExecBase trait for v1 write
>
[
https://issues.apache.org/jira/browse/SPARK-48004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-48004.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46240
[
https://issues.apache.org/jira/browse/SPARK-48007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48007:
---
Labels: pull-request-available (was: )
> MsSQLServer: upgrade mssql.jdbc.version to
[
https://issues.apache.org/jira/browse/SPARK-48006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48006:
---
Labels: pull-request-available (was: )
> add SortOrder for window function which has no
Kent Yao created SPARK-48007:
Summary: MsSQLServer: upgrade mssql.jdbc.version to 12.6.1.jre11
Key: SPARK-48007
URL: https://issues.apache.org/jira/browse/SPARK-48007
Project: Spark
Issue Type:
guihuawen created SPARK-48006:
-
Summary: add SortOrder for window function which has no orderSpec
Key: SPARK-48006
URL: https://issues.apache.org/jira/browse/SPARK-48006
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot reassigned SPARK-46122:
--
Assignee: (was: Apache Spark)
> Set `spark.sql.legacy.createHiveTableByDefault`
[
https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot reassigned SPARK-46122:
--
Assignee: Apache Spark
> Set `spark.sql.legacy.createHiveTableByDefault` to `false`
[
https://issues.apache.org/jira/browse/SPARK-48003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot reassigned SPARK-48003:
--
Assignee: Apache Spark
> Hll sketch aggregate support for strings with collation
>
[
https://issues.apache.org/jira/browse/SPARK-48005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48005:
---
Labels: pull-request-available (was: )
> Enable `DefaultIndexParityTests.
Ruifeng Zheng created SPARK-48005:
-
Summary: Enable `DefaultIndexParityTests.
test_index_distributed_sequence_cleanup`
Key: SPARK-48005
URL: https://issues.apache.org/jira/browse/SPARK-48005
Project:
[
https://issues.apache.org/jira/browse/SPARK-48003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48003:
---
Labels: pull-request-available (was: )
> Hll sketch aggregate support for strings with
[
https://issues.apache.org/jira/browse/SPARK-47993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-47993.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46228
[
https://issues.apache.org/jira/browse/SPARK-48004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48004:
---
Labels: pull-request-available (was: )
> Add WriteFilesExecBase trait for v1 write
>
XiDuo You created SPARK-48004:
-
Summary: Add WriteFilesExecBase trait for v1 write
Key: SPARK-48004
URL: https://issues.apache.org/jira/browse/SPARK-48004
Project: Spark
Issue Type: Task
Uroš Bojanić created SPARK-48003:
Summary: Hll sketch aggregate support for strings with collation
Key: SPARK-48003
URL: https://issues.apache.org/jira/browse/SPARK-48003
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-48001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-48001.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46238
[
https://issues.apache.org/jira/browse/SPARK-48001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-48001:
Assignee: Yang Jie
> Remove unused `private implicit def arrayToArrayWritable` from
[
https://issues.apache.org/jira/browse/SPARK-47968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47968:
---
Labels: pull-request-available (was: )
> MsSQLServer: Map datatimeoffset to TimestampType
[
https://issues.apache.org/jira/browse/SPARK-47986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-47986.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46221
[
https://issues.apache.org/jira/browse/SPARK-48001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48001:
---
Labels: pull-request-available (was: )
> Remove unused `private implicit def
[
https://issues.apache.org/jira/browse/SPARK-48002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-48002:
---
Labels: pull-request-available (was: )
> Add Observed metrics test in PySpark
Wei Liu created SPARK-48002:
---
Summary: Add Observed metrics test in PySpark
StreamingQueryListeners
Key: SPARK-48002
URL: https://issues.apache.org/jira/browse/SPARK-48002
Project: Spark
Issue
Yang Jie created SPARK-48001:
Summary: Remove unused `private implicit def arrayToArrayWritable`
from `SparkContext`
Key: SPARK-48001
URL: https://issues.apache.org/jira/browse/SPARK-48001
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-47922.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 46141
[
https://issues.apache.org/jira/browse/SPARK-47440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao updated SPARK-47440:
-
Parent: SPARK-47361
Issue Type: Sub-task (was: Bug)
> SQLServer does not support LIKE operator
85 matches
Mail list logo
