[
https://issues.apache.org/jira/browse/SPARK-43787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng resolved SPARK-43787.
Resolution: Won't Fix
> Improve the method signature by given default None for Option
>
[
https://issues.apache.org/jira/browse/SPARK-43790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-43790:
---
Description:
In new distributed spark ML module (designed to support spark connect and
support
[
https://issues.apache.org/jira/browse/SPARK-43790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu reassigned SPARK-43790:
--
Assignee: Weichen Xu
> Add API `copyLocalFileToHadoopFS`
> -
Weichen Xu created SPARK-43790:
--
Summary: Add API `copyLocalFileToHadoopFS`
Key: SPARK-43790
URL: https://issues.apache.org/jira/browse/SPARK-43790
Project: Spark
Issue Type: Sub-task
Hyukjin Kwon created SPARK-43789:
Summary: Uses 'spark.sql.execution.arrow.maxRecordsPerBatch' in R
createDataFrame with Arrow by default
Key: SPARK-43789
URL: https://issues.apache.org/jira/browse/SPARK-43789
Haejoon Lee created SPARK-43788:
---
Summary: Enable SummarizerTests.test_summarize_dataframe for
pandas 2.0.0.
Key: SPARK-43788
URL: https://issues.apache.org/jira/browse/SPARK-43788
Project: Spark
jiaan.geng created SPARK-43787:
--
Summary: Improve the method signature by given default None for
Option
Key: SPARK-43787
URL: https://issues.apache.org/jira/browse/SPARK-43787
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726043#comment-17726043
]
Snoot.io commented on SPARK-43679:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726042#comment-17726042
]
Snoot.io commented on SPARK-43677:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726041#comment-17726041
]
Snoot.io commented on SPARK-43676:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726039#comment-17726039
]
Snoot.io commented on SPARK-43529:
--
User 'dtenedor' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726040#comment-17726040
]
Snoot.io commented on SPARK-43676:
--
User 'itholic' has created a pull request for this issue:
[ https://issues.apache.org/jira/browse/SPARK-40586 ]
jiaan.geng deleted comment on SPARK-40586:
was (Author: beliefer):
I will take a look!
> Decouple plan transformation and validation on server side
>
[
https://issues.apache.org/jira/browse/SPARK-43669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726038#comment-17726038
]
Snoot.io commented on SPARK-43669:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726037#comment-17726037
]
Snoot.io commented on SPARK-43668:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726036#comment-17726036
]
Snoot.io commented on SPARK-43667:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726035#comment-17726035
]
Snoot.io commented on SPARK-43667:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726034#comment-17726034
]
Snoot.io commented on SPARK-43666:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-43666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726033#comment-17726033
]
Snoot.io commented on SPARK-43666:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726032#comment-17726032
]
Snoot.io commented on SPARK-4:
--
User 'siying' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-38079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726030#comment-17726030
]
zuotingbing commented on SPARK-38079:
-
We face the same problem. Is there anybody follow this issue?
[
https://issues.apache.org/jira/browse/SPARK-43786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-43786:
Description: Make testing more robust about 'levenshtein' function.
> Add a test for nullability
[
https://issues.apache.org/jira/browse/SPARK-43545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43545.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41240
[
https://issues.apache.org/jira/browse/SPARK-43777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726025#comment-17726025
]
XiDuo You commented on SPARK-43777:
---
It acutally is a random event that all the row count of id 2 are
[
https://issues.apache.org/jira/browse/SPARK-43785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-43785:
---
Description:
{code:java}
build/sbt "sql/Test/runMain --dsdgenDir --location
--scaleFactor 1"
BingKun Pan created SPARK-43786:
---
Summary: Add a test for nullability about 'levenshtein' function
Key: SPARK-43786
URL: https://issues.apache.org/jira/browse/SPARK-43786
Project: Spark
Issue
jiaan.geng created SPARK-43785:
--
Summary: Improve the document of GenTPCDSData, so that developers
could easy to generate TPCDS table data.
Key: SPARK-43785
URL: https://issues.apache.org/jira/browse/SPARK-43785
[
https://issues.apache.org/jira/browse/SPARK-38472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726022#comment-17726022
]
BingKun Pan commented on SPARK-38472:
-
I work on it.
> Use error classes in org.apache.spark.rpc
>
Haejoon Lee created SPARK-43783:
---
Summary: Enable FeatureTests.test_standard_scaler for pandas 2.0.0.
Key: SPARK-43783
URL: https://issues.apache.org/jira/browse/SPARK-43783
Project: Spark
Haejoon Lee created SPARK-43784:
---
Summary: Enable FeatureTests.test_max_abs_scaler for pandas 2.0.0.
Key: SPARK-43784
URL: https://issues.apache.org/jira/browse/SPARK-43784
Project: Spark
Yan-Lin (Jared) Wang created SPARK-43782:
Summary: Support log level configuration with static Spark conf
Key: SPARK-43782
URL: https://issues.apache.org/jira/browse/SPARK-43782
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-43334:
Assignee: Thejdeep
> Error while serializing ExecutorPeakMetricsDistributions into API
[
https://issues.apache.org/jira/browse/SPARK-43334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-43334.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41017
Derek Murray created SPARK-43781:
Summary: IllegalStateException when cogrouping two datasets
derived from the same source
Key: SPARK-43781
URL: https://issues.apache.org/jira/browse/SPARK-43781
[
https://issues.apache.org/jira/browse/SPARK-43290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Weis updated SPARK-43290:
---
Summary: Support IV and AAD optional parameters for aes_encrypt /
ExpressionImplUtil (was: Support
[
https://issues.apache.org/jira/browse/SPARK-43290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Weis reopened SPARK-43290:
I'm reopening this because we landed the first half of changes and still need
to link them up to
[
https://issues.apache.org/jira/browse/SPARK-43290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Weis updated SPARK-43290:
---
Summary: Support IV and AAD optional parameters for ExpressionImplUtil
(was: Support IV and AAD
[ https://issues.apache.org/jira/browse/SPARK-43543 ]
Xinrong Meng deleted comment on SPARK-43543:
--
was (Author: xinrongm):
Issue resolved by pull request 41147
[https://github.com/apache/spark/pull/41147]
> Standardize Nested Complex
[
https://issues.apache.org/jira/browse/SPARK-43544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725949#comment-17725949
]
Xinrong Meng commented on SPARK-43544:
--
Resolved by https://github.com/apache/spark/pull/41147.
>
[
https://issues.apache.org/jira/browse/SPARK-43544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng reassigned SPARK-43544:
Assignee: Xinrong Meng
> Fix nested MapType behavior in Pandas UDF
>
[
https://issues.apache.org/jira/browse/SPARK-43544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng resolved SPARK-43544.
--
Resolution: Done
> Fix nested MapType behavior in Pandas UDF
>
Andrey Gubichev created SPARK-43780:
---
Summary: Support correlated columns in join ON conditions
Key: SPARK-43780
URL: https://issues.apache.org/jira/browse/SPARK-43780
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-43760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrey Gubichev updated SPARK-43760:
Description:
The following query:
{code:java}
select * from (
select t1.id c1, (
Rui Wang created SPARK-43779:
Summary: To_date should load the EvalMode in main thread
Key: SPARK-43779
URL: https://issues.apache.org/jira/browse/SPARK-43779
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-43779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-43779:
-
Summary: ParseToDate should load the EvalMode in main thread (was: To_date
should load the EvalMode in
[
https://issues.apache.org/jira/browse/SPARK-37690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid resolved SPARK-37690.
--
Fix Version/s: 3.2.2
3.3.0
Resolution: Duplicate
> Recursive view
[
https://issues.apache.org/jira/browse/SPARK-43778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrey Gubichev updated SPARK-43778:
Description:
This is a correctness problem caused by the fact that the decorrelation rule
[
https://issues.apache.org/jira/browse/SPARK-43778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrey Gubichev updated SPARK-43778:
Description:
This is a correctness problem caused by the fact that the decorrelation rule
Andrey Gubichev created SPARK-43778:
---
Summary: RewriteCorrelatedScalarSubquery should handle duplicate
attributes
Key: SPARK-43778
URL: https://issues.apache.org/jira/browse/SPARK-43778
Project:
[
https://issues.apache.org/jira/browse/SPARK-43777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kristopher Kane updated SPARK-43777:
Description:
While updating our code base from 3.1 to 3.3, I had a test fail due to wrong
[
https://issues.apache.org/jira/browse/SPARK-43777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kristopher Kane updated SPARK-43777:
Description:
While updating our code base from 3.1 to 3.3, I had a test fail due to wrong
[
https://issues.apache.org/jira/browse/SPARK-43777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kristopher Kane updated SPARK-43777:
Description:
While updating our code base from 3.1 to 3.3, I had a test fail due to wrong
Kristopher Kane created SPARK-43777:
---
Summary: Coalescing partitions in AQE returns different results
with row_number windows.
Key: SPARK-43777
URL: https://issues.apache.org/jira/browse/SPARK-43777
[
https://issues.apache.org/jira/browse/SPARK-43573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-43573:
-
Priority: Trivial (was: Major)
> Make SparkBuilder could config the heap size of test JVM.
>
[
https://issues.apache.org/jira/browse/SPARK-43573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-43573.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41212
[
https://issues.apache.org/jira/browse/SPARK-43573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-43573:
Assignee: jiaan.geng
> Make SparkBuilder could config the heap size of test JVM.
>
[
https://issues.apache.org/jira/browse/SPARK-43776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
melin updated SPARK-43776:
--
Description:
JDBCRDD.scala: stmt.setFetchSize(options.fetchSize)
JdbcRDD.scala:
{code:java}
if
melin created SPARK-43776:
-
Summary: [BUG] MySQL jdbc cursor has not taken effect
Key: SPARK-43776
URL: https://issues.apache.org/jira/browse/SPARK-43776
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-43776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
melin updated SPARK-43776:
--
Description:
JDBCRDD.scala: stmt.setFetchSize(options.fetchSize)
JdbcRDD.scala:
{code:java}
if
Anton Okolnychyi created SPARK-43775:
Summary: DataSource V2: Allow representing updates as deletes and
inserts
Key: SPARK-43775
URL: https://issues.apache.org/jira/browse/SPARK-43775
Project:
[
https://issues.apache.org/jira/browse/SPARK-43771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-43771:
Assignee: BingKun Pan
> Upgrade mima-core from 1.1.0 to 1.1.2
>
[
https://issues.apache.org/jira/browse/SPARK-43771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-43771.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41294
[
https://issues.apache.org/jira/browse/SPARK-43739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-43739:
-
Assignee: BingKun Pan
> Upgrade commons-io to 2.12.0
>
>
[
https://issues.apache.org/jira/browse/SPARK-43739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-43739.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41271
[
https://issues.apache.org/jira/browse/SPARK-43774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-43774:
-
Description:
[https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.15.1]
> Upgrade Jackson to
Yang Jie created SPARK-43774:
Summary: Upgrade Jackson to 2.15.1
Key: SPARK-43774
URL: https://issues.apache.org/jira/browse/SPARK-43774
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Kruszewski updated SPARK-21195:
--
Labels: (was: bulk-closed)
> MetricSystem should pick up dynamically registered
[ https://issues.apache.org/jira/browse/SPARK-41875 ]
jiaan.geng deleted comment on SPARK-41875:
was (Author: beliefer):
I will take a look!
> Throw proper errors in Dataset.to()
> ---
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-40586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725815#comment-17725815
]
jiaan.geng commented on SPARK-40586:
I will take a look!
> Decouple plan transformation and
[
https://issues.apache.org/jira/browse/SPARK-38464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-38464.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41277
[
https://issues.apache.org/jira/browse/SPARK-38464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-38464:
Assignee: Bo Zhang
> Use error classes in org.apache.spark.io
>
[ https://issues.apache.org/jira/browse/SPARK-42669 ]
jiaan.geng deleted comment on SPARK-42669:
was (Author: beliefer):
I will take a look!
> Short circuit local relation rpcs
> -
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-43516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-43516:
---
Description:
* Define basic interfaces of Evaluator / Transformer / Model / Evaluator, these
[
https://issues.apache.org/jira/browse/SPARK-43773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-43773:
Description: After Add a max distance argument to the levenshtein()
function We have already
[
https://issues.apache.org/jira/browse/SPARK-43516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-43516:
---
Summary: Basic estimator / transformer / model / evaluator interfaces and
basic transformer /
[
https://issues.apache.org/jira/browse/SPARK-43516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu resolved SPARK-43516.
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41176
[
https://issues.apache.org/jira/browse/SPARK-43773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725697#comment-17725697
]
BingKun Pan commented on SPARK-43773:
-
I work on it
> Implement 'levenshtein(str1, str2[,
BingKun Pan created SPARK-43773:
---
Summary: Implement 'levenshtein(str1, str2[, threshold])'
functions in python client
Key: SPARK-43773
URL: https://issues.apache.org/jira/browse/SPARK-43773
Project:
[
https://issues.apache.org/jira/browse/SPARK-43546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43546.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41268
[
https://issues.apache.org/jira/browse/SPARK-43772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725679#comment-17725679
]
BingKun Pan commented on SPARK-43772:
-
I work on it
> Move version configuration in `connect`
[
https://issues.apache.org/jira/browse/SPARK-43546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43546:
-
Assignee: Xinrong Meng
> Complete parity tests of Pandas UDF
>
[
https://issues.apache.org/jira/browse/SPARK-43772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-43772:
Description:
In the pom file of the submodule, there are some common version properties, eg:
*
BingKun Pan created SPARK-43772:
---
Summary: Move version configuration in `connect` module to parent
Key: SPARK-43772
URL: https://issues.apache.org/jira/browse/SPARK-43772
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-43741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-43741:
Assignee: BingKun Pan
> Upgrade maven-checkstyle-plugin from 3.2.2 to 3.3.0
>
[
https://issues.apache.org/jira/browse/SPARK-43741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-43741.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41275
BingKun Pan created SPARK-43771:
---
Summary: Upgrade mima-core from 1.1.0 to 1.1.2
Key: SPARK-43771
URL: https://issues.apache.org/jira/browse/SPARK-43771
Project: Spark
Issue Type: Improvement
clouds created SPARK-43770:
--
Summary: request unlimited DecimalType
Key: SPARK-43770
URL: https://issues.apache.org/jira/browse/SPARK-43770
Project: Spark
Issue Type: Improvement
87 matches
Mail list logo
