Zhongwei Zhu created SPARK-43828:
Summary: Add config to control whether close idle connection
Key: SPARK-43828
URL: https://issues.apache.org/jira/browse/SPARK-43828
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-41775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726768#comment-17726768
]
Snoot.io commented on SPARK-41775:
--
User 'WeichenXu123' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726767#comment-17726767
]
Snoot.io commented on SPARK-43775:
--
User 'aokolnychyi' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-43818:
Language: (was: English)
> Spark Glue job introduces duplicates while writing a dataframe as
[
https://issues.apache.org/jira/browse/SPARK-43802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726764#comment-17726764
]
Dongjoon Hyun commented on SPARK-43802:
---
This is backported to branch-3.4 via
[
https://issues.apache.org/jira/browse/SPARK-43802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-43802:
--
Issue Type: Bug (was: New Feature)
> unbase64 and unhex codegen are invalid with failOnError
[
https://issues.apache.org/jira/browse/SPARK-43802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-43802:
--
Fix Version/s: 3.4.1
> unbase64 and unhex codegen are invalid with failOnError
>
jiaan.geng created SPARK-43827:
--
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2417
Key: SPARK-43827
URL: https://issues.apache.org/jira/browse/SPARK-43827
Project: Spark
Issue
jiaan.geng created SPARK-43826:
--
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2416
Key: SPARK-43826
URL: https://issues.apache.org/jira/browse/SPARK-43826
Project: Spark
Issue
BingKun Pan created SPARK-43824:
---
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1281
Key: SPARK-43824
URL: https://issues.apache.org/jira/browse/SPARK-43824
Project: Spark
Issue
BingKun Pan created SPARK-43825:
---
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1282
Key: SPARK-43825
URL: https://issues.apache.org/jira/browse/SPARK-43825
Project: Spark
Issue
jiaan.geng created SPARK-43823:
--
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2414
Key: SPARK-43823
URL: https://issues.apache.org/jira/browse/SPARK-43823
Project: Spark
Issue
jiaan.geng created SPARK-43822:
--
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2413
Key: SPARK-43822
URL: https://issues.apache.org/jira/browse/SPARK-43822
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-43821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-43821:
Description:
When I am running tests in ClientE2ETestSuite, I often cannot locate them
through
[
https://issues.apache.org/jira/browse/SPARK-43821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-43821:
Description:
When I am running tests in ClientE2ETestSuite, I often cannot locate them
through
BingKun Pan created SPARK-43821:
---
Summary: Make the prompt for `findJar` method in
IntegrationTestUtils clearer
Key: SPARK-43821
URL: https://issues.apache.org/jira/browse/SPARK-43821
Project: Spark
jiaan.geng created SPARK-43820:
--
Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2411
Key: SPARK-43820
URL: https://issues.apache.org/jira/browse/SPARK-43820
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-43205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-43205:
--
Assignee: Serge Rielau
> Add an IDENTIFIER(stringLiteral) clause that maps a string
[
https://issues.apache.org/jira/browse/SPARK-43205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-43205.
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41007
Matthew Tieman created SPARK-43819:
--
Summary: Barrier Executor Stage Not Retried
Key: SPARK-43819
URL: https://issues.apache.org/jira/browse/SPARK-43819
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-43819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Tieman updated SPARK-43819:
---
Summary: Barrier Executor Stage Not Retried on Task Failure (was: Barrier
Executor Stage
[
https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Yu updated SPARK-43815:
---
Description:
We want to add the alias to_varchar for the function to_char.
For users who are
[
https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Yu updated SPARK-43815:
---
Description:
We want to add the alias to_varchar for the function to_char.
For users who are
[
https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Yu updated SPARK-43815:
---
Summary: Add to_varchar alias for to_char SQL function (was: Add SQL
functions to_varchar alias
[
https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Yu updated SPARK-43815:
---
Summary: Add SQL functions to_varchar alias for to_char (was: Add SQL
functions to_varchar and
[
https://issues.apache.org/jira/browse/SPARK-41660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726740#comment-17726740
]
Thomas Graves commented on SPARK-41660:
---
it looks like this was backported to 3.3. with
[
https://issues.apache.org/jira/browse/SPARK-41660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-41660:
--
Fix Version/s: 3.3.3
> only propagate metadata columns if they are used
>
[
https://issues.apache.org/jira/browse/SPARK-43366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724303#comment-17724303
]
Sean R. Owen edited comment on SPARK-43366 at 5/26/23 8:04 PM:
---
-Was the
[
https://issues.apache.org/jira/browse/SPARK-43366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726731#comment-17726731
]
Sean R. Owen commented on SPARK-43366:
--
Ack yeah, nevermind. Reading too fast without coffee. That
[
https://issues.apache.org/jira/browse/SPARK-43366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726727#comment-17726727
]
Derek Brown commented on SPARK-43366:
-
[~srowen] the issue isn't with the port; the issue is with
[
https://issues.apache.org/jira/browse/SPARK-43766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43766:
Assignee: jiaan.geng
> Assign a name to the error class _LEGACY_ERROR_TEMP_2410
>
[
https://issues.apache.org/jira/browse/SPARK-43765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43765:
Assignee: jiaan.geng
> Assign a name to the error class _LEGACY_ERROR_TEMP_2409
>
[
https://issues.apache.org/jira/browse/SPARK-43764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43764.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41290
[
https://issues.apache.org/jira/browse/SPARK-43762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43762:
Assignee: jiaan.geng
> Assign a name to the error class _LEGACY_ERROR_TEMP_2406
>
[
https://issues.apache.org/jira/browse/SPARK-43762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43762.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41290
[
https://issues.apache.org/jira/browse/SPARK-43766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43766.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41290
[
https://issues.apache.org/jira/browse/SPARK-43765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43765.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41290
[
https://issues.apache.org/jira/browse/SPARK-43764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43764:
Assignee: jiaan.geng
> Assign a name to the error class _LEGACY_ERROR_TEMP_2408
>
[
https://issues.apache.org/jira/browse/SPARK-43763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43763.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41290
[
https://issues.apache.org/jira/browse/SPARK-43763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43763:
Assignee: jiaan.geng
> Assign a name to the error class _LEGACY_ERROR_TEMP_2407
>
Umesh Kant created SPARK-43818:
--
Summary: Spark Glue job introduces duplicates while writing a
dataframe as file to S3
Key: SPARK-43818
URL: https://issues.apache.org/jira/browse/SPARK-43818
Project:
[
https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726704#comment-17726704
]
Max Gekk commented on SPARK-43815:
--
[~ryu796] Let's focus on the first item, and create separate JIRAs
[
https://issues.apache.org/jira/browse/SPARK-43808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43808.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41331
[
https://issues.apache.org/jira/browse/SPARK-43808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43808:
Assignee: BingKun Pan
> Use `checkError()` to check `Exception` in `SQLViewTestSuite`
>
Takuya Ueshin created SPARK-43817:
-
Summary: Support UserDefinedType in creaetDataFrame from pandas
DataFrame and toPandas
Key: SPARK-43817
URL: https://issues.apache.org/jira/browse/SPARK-43817
[
https://issues.apache.org/jira/browse/SPARK-43816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sai Allu updated SPARK-43816:
-
Description:
h1. Bug Context
Hello! I would like to report a bug that my team noticed while we were
Sai Allu created SPARK-43816:
Summary: Spark Corrupts Data In-Transit for High Volume (> 20
TB/hr) of Data
Key: SPARK-43816
URL: https://issues.apache.org/jira/browse/SPARK-43816
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43802.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41317
[
https://issues.apache.org/jira/browse/SPARK-43802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43802:
Assignee: Adam Binford
> unbase64 and unhex codegen are invalid with failOnError
>
[
https://issues.apache.org/jira/browse/SPARK-43801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726671#comment-17726671
]
Pucheng Yang commented on SPARK-43801:
--
created PR https://github.com/apache/spark/pull/41332
>
[
https://issues.apache.org/jira/browse/SPARK-43188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicolas PHUNG resolved SPARK-43188.
---
Resolution: Workaround
> Cannot write to Azure Datalake Gen2 (abfs/abfss) after Spark 3.1.2
[
https://issues.apache.org/jira/browse/SPARK-43188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726667#comment-17726667
]
Nicolas PHUNG commented on SPARK-43188:
---
Hello [~srowen] I don't think so, but I manage to get it
[
https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Yu updated SPARK-43815:
---
Description:
We want to add support for the follow functions:
* to_varchar() as an alias for
[
https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Yu updated SPARK-43815:
---
Description:
Today, users who have SQL engines which support \{code:java} to_varchar \{code}
[
https://issues.apache.org/jira/browse/SPARK-43815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Yu updated SPARK-43815:
---
Description:
Today, users who have SQL engines which support ```to_varchar``` needs to
change
Richard Yu created SPARK-43815:
--
Summary: Add SQL functions to_varchar and extend to_char
functionality
Key: SPARK-43815
URL: https://issues.apache.org/jira/browse/SPARK-43815
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43794:
Assignee: BingKun Pan
> Assign a name to the error class _LEGACY_ERROR_TEMP_1335
>
[
https://issues.apache.org/jira/browse/SPARK-43794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43794.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41314
[
https://issues.apache.org/jira/browse/SPARK-43805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726627#comment-17726627
]
Jia Fan commented on SPARK-43805:
-
Tell the truth, I'm don't know will spark accept this statement? It
[
https://issues.apache.org/jira/browse/SPARK-43814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Jia updated SPARK-43814:
---
Description:
When using the df.collect() result to construct the DecimalType in
[
https://issues.apache.org/jira/browse/SPARK-43765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726549#comment-17726549
]
ASF GitHub Bot commented on SPARK-43765:
User 'beliefer' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726548#comment-17726548
]
ASF GitHub Bot commented on SPARK-43764:
User 'beliefer' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726546#comment-17726546
]
ASF GitHub Bot commented on SPARK-43763:
User 'beliefer' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726544#comment-17726544
]
ASF GitHub Bot commented on SPARK-43763:
User 'beliefer' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726543#comment-17726543
]
ASF GitHub Bot commented on SPARK-43762:
User 'beliefer' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Jia updated SPARK-43814:
---
Description:
When using the df.collect() result to construct the DecimalType in
Decimal scale (18) cannot
Ke Jia created SPARK-43814:
--
Summary: Spark cannot use the df.collect() result to construct the
DecimalType in CatalystTypeConverters.convertToCatalyst() API
Key: SPARK-43814
URL:
Haejoon Lee created SPARK-43813:
---
Summary: Enable
CategoricalTests.test_groupby_apply_without_shortcut for pandas 2.0.0.
Key: SPARK-43813
URL: https://issues.apache.org/jira/browse/SPARK-43813
Project:
Haejoon Lee created SPARK-43812:
---
Summary: Enable DataFrameTests.test_all for pandas 2.0.0.
Key: SPARK-43812
URL: https://issues.apache.org/jira/browse/SPARK-43812
Project: Spark
Issue Type:
Haejoon Lee created SPARK-43811:
---
Summary: Enable DataFrameTests.test_reindex for pandas 2.0.0.
Key: SPARK-43811
URL: https://issues.apache.org/jira/browse/SPARK-43811
Project: Spark
Issue
Haejoon Lee created SPARK-43809:
---
Summary: Enable DataFrameSlowTests.test_cov for pandas 2.0.0.
Key: SPARK-43809
URL: https://issues.apache.org/jira/browse/SPARK-43809
Project: Spark
Issue
Haejoon Lee created SPARK-43810:
---
Summary: Enable DataFrameSlowTests.test_quantile for pandas 2.0.0.
Key: SPARK-43810
URL: https://issues.apache.org/jira/browse/SPARK-43810
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43807.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41325
[
https://issues.apache.org/jira/browse/SPARK-43807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43807:
Assignee: jiaan.geng
> Migrate _LEGACY_ERROR_TEMP_1269 to PARTITION_SCHEMA_IS_EMPTY
>
[
https://issues.apache.org/jira/browse/SPARK-43576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43576.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41218
[
https://issues.apache.org/jira/browse/SPARK-43576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43576:
Assignee: BingKun Pan
> Remove unused declarations from Core module
>
[
https://issues.apache.org/jira/browse/SPARK-43795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43795.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41313
[
https://issues.apache.org/jira/browse/SPARK-43795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43795:
-
Assignee: jiaan.geng
> Remove parameters not used for SparkConnectPlanner
>
[
https://issues.apache.org/jira/browse/SPARK-43791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43791:
Assignee: BingKun Pan
> Assign a name to the error class _LEGACY_ERROR_TEMP_1336
>
[
https://issues.apache.org/jira/browse/SPARK-43791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43791.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41309
BingKun Pan created SPARK-43808:
---
Summary: Use `checkError()` to check `Exception` in
`SQLViewTestSuite`
Key: SPARK-43808
URL: https://issues.apache.org/jira/browse/SPARK-43808
Project: Spark
81 matches
Mail list logo
