[
https://issues.apache.org/jira/browse/SPARK-40157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40157:
Assignee: Apache Spark (was: Ruifeng Zheng)
> Make pyspark.files examples
[
https://issues.apache.org/jira/browse/SPARK-40157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40157:
Assignee: Ruifeng Zheng (was: Apache Spark)
> Make pyspark.files examples
[
https://issues.apache.org/jira/browse/SPARK-40157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582738#comment-17582738
]
Apache Spark commented on SPARK-40157:
--
User 'zhengruifeng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582735#comment-17582735
]
Hyukjin Kwon commented on SPARK-40173:
--
im working on this.
> Make pyspark.taskcontext examples
Hyukjin Kwon created SPARK-40173:
Summary: Make pyspark.taskcontext examples self-contained
Key: SPARK-40173
URL: https://issues.apache.org/jira/browse/SPARK-40173
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-40172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40172:
Assignee: Gengliang Wang (was: Apache Spark)
> Temporarily disable flaky test cases in
[
https://issues.apache.org/jira/browse/SPARK-40172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582722#comment-17582722
]
Apache Spark commented on SPARK-40172:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582723#comment-17582723
]
Apache Spark commented on SPARK-40172:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40172:
Assignee: Apache Spark (was: Gengliang Wang)
> Temporarily disable flaky test cases in
[
https://issues.apache.org/jira/browse/SPARK-40171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582721#comment-17582721
]
Gengliang Wang commented on SPARK-40171:
cc [~weichenxu123]
> Fix flaky tests in
Gengliang Wang created SPARK-40172:
--
Summary: Temporarily disable flaky test cases in
ImageFileFormatSuite
Key: SPARK-40172
URL: https://issues.apache.org/jira/browse/SPARK-40172
Project: Spark
Gengliang Wang created SPARK-40171:
--
Summary: Fix flaky tests in ImageFileFormatSuite
Key: SPARK-40171
URL: https://issues.apache.org/jira/browse/SPARK-40171
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582709#comment-17582709
]
Hyukjin Kwon commented on SPARK-40149:
--
[~karenfeng] FYI
> Star expansion after outer join
[
https://issues.apache.org/jira/browse/SPARK-40140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40140.
--
Resolution: Cannot Reproduce
> REST API for SQL level information does not show information
[
https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582707#comment-17582707
]
XiDuo You commented on SPARK-39915:
---
We may need a more strict machine to ensure the output partition
[
https://issues.apache.org/jira/browse/SPARK-40170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582708#comment-17582708
]
caican commented on SPARK-40170:
gently ping [~sowen] [~r...@databricks.com]
> StringCoding UTF8
[
https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582703#comment-17582703
]
XiDuo You commented on SPARK-39915:
---
Thank you [~yumwang] for ping me. I see this issue.
This is
[
https://issues.apache.org/jira/browse/SPARK-40170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caican updated SPARK-40170:
---
Description:
When `UnsafeRow` is converted to `Row` at
[
https://issues.apache.org/jira/browse/SPARK-40170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caican updated SPARK-40170:
---
Attachment: image-2022-08-22-10-57-11-744.png
> StringCoding UTF8 decode slowly
>
[
https://issues.apache.org/jira/browse/SPARK-40170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caican updated SPARK-40170:
---
Description:
When `UnsafeRow` is converted to `Row` at
[
https://issues.apache.org/jira/browse/SPARK-40170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caican updated SPARK-40170:
---
Attachment: image-2022-08-22-10-56-54-768.png
> StringCoding UTF8 decode slowly
>
caican created SPARK-40170:
--
Summary: StringCoding UTF8 decode slowly
Key: SPARK-40170
URL: https://issues.apache.org/jira/browse/SPARK-40170
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-40074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anuj Gargava updated SPARK-40074:
-
Affects Version/s: 3.3.0
> Error while creating dataset in Java spark-3.x using Encoders bean
[
https://issues.apache.org/jira/browse/SPARK-40074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anuj Gargava updated SPARK-40074:
-
Affects Version/s: 3.2.2
> Error while creating dataset in Java spark-3.x using Encoders bean
[
https://issues.apache.org/jira/browse/SPARK-40169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582664#comment-17582664
]
Ivan Sadikov commented on SPARK-40169:
--
I would like to work on it as it was my responsibility to
[
https://issues.apache.org/jira/browse/SPARK-40169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40169:
-
Description:
This is a follow for SPARK-39833. In
Ivan Sadikov created SPARK-40169:
Summary: Fix the issue with Parquet column index and predicate
pushdown in Data source V1
Key: SPARK-40169
URL: https://issues.apache.org/jira/browse/SPARK-40169
[
https://issues.apache.org/jira/browse/SPARK-40156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582643#comment-17582643
]
Serge Rielau commented on SPARK-40156:
--
+ [~maxgekk]
For new function. we should be using the new
[
https://issues.apache.org/jira/browse/SPARK-40168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40168:
Assignee: Apache Spark
> Handle FileNotFoundException when shuffle file deleted in
[
https://issues.apache.org/jira/browse/SPARK-40168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40168:
Assignee: (was: Apache Spark)
> Handle FileNotFoundException when shuffle file
[
https://issues.apache.org/jira/browse/SPARK-40168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582634#comment-17582634
]
Apache Spark commented on SPARK-40168:
--
User 'warrenzhu25' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongwei Zhu updated SPARK-40168:
-
Description:
When shuffle files not found, decommissioner will handles IOException, but the
[
https://issues.apache.org/jira/browse/SPARK-40168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongwei Zhu updated SPARK-40168:
-
Description:
{code:java}
// Some comments here
public String getFoo()
{
return foo;
}
Zhongwei Zhu created SPARK-40168:
Summary: Handle FileNotFoundException when shuffle file deleted in
decommissioner
Key: SPARK-40168
URL: https://issues.apache.org/jira/browse/SPARK-40168
Project:
[
https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40152.
--
Fix Version/s: 3.4.0
3.3.1
Assignee: Yuming Wang
[
https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40163.
--
Fix Version/s: 3.4.0
Assignee: seunggabi
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-40167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40167:
Assignee: (was: Apache Spark)
> Add array_sort(column, comparator) to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-40167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40167:
Assignee: Apache Spark
> Add array_sort(column, comparator) to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-40167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582570#comment-17582570
]
Apache Spark commented on SPARK-40167:
--
User 'zero323' has created a pull request for this issue:
Maciej Szymkiewicz created SPARK-40167:
--
Summary: Add array_sort(column, comparator) to SparkR
Key: SPARK-40167
URL: https://issues.apache.org/jira/browse/SPARK-40167
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582568#comment-17582568
]
Apache Spark commented on SPARK-40164:
--
User 'wankunde' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40164:
Assignee: (was: Apache Spark)
> The partitionSpec should be distinct keys after
[
https://issues.apache.org/jira/browse/SPARK-40164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40164:
Assignee: Apache Spark
> The partitionSpec should be distinct keys after filter one row
[
https://issues.apache.org/jira/browse/SPARK-40150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582564#comment-17582564
]
Apache Spark commented on SPARK-40150:
--
User 'jackylee-ch' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40150:
Assignee: (was: Apache Spark)
> Dynamically merge File Splits
>
[
https://issues.apache.org/jira/browse/SPARK-40150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40150:
Assignee: Apache Spark
> Dynamically merge File Splits
> -
>
[
https://issues.apache.org/jira/browse/SPARK-40162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40162.
--
Assignee: BingKun Pan
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40165.
--
Assignee: BingKun Pan
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-40165:
-
Priority: Trivial (was: Minor)
> Update test plugins to latest versions
>
[
https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40163:
Assignee: (was: Apache Spark)
> [SPARK][SQL] feat: SparkSession.confing(Map)
>
[
https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40163:
Assignee: Apache Spark
> [SPARK][SQL] feat: SparkSession.confing(Map)
>
[
https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582549#comment-17582549
]
Apache Spark commented on SPARK-40163:
--
User 'seunggabi' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40166:
Assignee: (was: Apache Spark)
> Add array_sort(column, comparator) to PySpark
>
[
https://issues.apache.org/jira/browse/SPARK-40166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582544#comment-17582544
]
Apache Spark commented on SPARK-40166:
--
User 'zero323' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40166:
Assignee: Apache Spark
> Add array_sort(column, comparator) to PySpark
>
Maciej Szymkiewicz created SPARK-40166:
--
Summary: Add array_sort(column, comparator) to PySpark
Key: SPARK-40166
URL: https://issues.apache.org/jira/browse/SPARK-40166
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582535#comment-17582535
]
Qian Sun commented on SPARK-40148:
--
[~hyukjin.kwon] OK, I'll create a follow-up PR to do these :)
>
[
https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582531#comment-17582531
]
Apache Spark commented on SPARK-40165:
--
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-40165:
Description:
Include:
* 1.scalacheck (from 1.15.4 to 1.16.0)
* 2.maven-surefire-plugin (from
[
https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40165:
Assignee: (was: Apache Spark)
> Update test plugins to latest versions
>
[
https://issues.apache.org/jira/browse/SPARK-40165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40165:
Assignee: Apache Spark
> Update test plugins to latest versions
>
BingKun Pan created SPARK-40165:
---
Summary: Update test plugins to latest versions
Key: SPARK-40165
URL: https://issues.apache.org/jira/browse/SPARK-40165
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-39833.
--
Fix Version/s: 3.3.1
3.2.3
3.4.0
Resolution:
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-39833:
Assignee: Ivan Sadikov
> Filtered parquet data frame count() and show() produce
Wan Kun created SPARK-40164:
---
Summary: The partitionSpec should be distinct keys after filter
one row of row_number
Key: SPARK-40164
URL: https://issues.apache.org/jira/browse/SPARK-40164
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582517#comment-17582517
]
Hyukjin Kwon commented on SPARK-40148:
--
Oops, my bad. Resolving.
I just noticed that we don't have
[
https://issues.apache.org/jira/browse/SPARK-40148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40148.
--
Resolution: Duplicate
> Make pyspark.sql.window examples self-contained
>
[
https://issues.apache.org/jira/browse/SPARK-40161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-40161:
Assignee: Ruifeng Zheng
> Make Series.mode apply PandasMode
>
[
https://issues.apache.org/jira/browse/SPARK-40161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40161.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37596
[
https://issues.apache.org/jira/browse/SPARK-39925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-39925.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37361
[
https://issues.apache.org/jira/browse/SPARK-39925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-39925:
Assignee: Brandon Dahler
> Add array_sort(column, comparator) overload to DataFrame
[
https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
seunggabi updated SPARK-40163:
--
Affects Version/s: 3.3.0
(was: 3.2.2)
> [SPARK][SQL] feat:
[
https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
seunggabi updated SPARK-40163:
--
Description:
[https://github.com/apache/spark/pull/37478]
- as-is
{code:java}
private fun
seunggabi created SPARK-40163:
-
Summary: [SPARK][SQL] feat: SparkSession.confing(Map)
Key: SPARK-40163
URL: https://issues.apache.org/jira/browse/SPARK-40163
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-40162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582489#comment-17582489
]
Apache Spark commented on SPARK-40162:
--
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40162:
Assignee: Apache Spark
> Upgrade RoaringBitmap from 0.9.30 to 0.9.31
>
[
https://issues.apache.org/jira/browse/SPARK-40162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40162:
Assignee: (was: Apache Spark)
> Upgrade RoaringBitmap from 0.9.30 to 0.9.31
>
[
https://issues.apache.org/jira/browse/SPARK-40162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582488#comment-17582488
]
Apache Spark commented on SPARK-40162:
--
User 'panbingkun' has created a pull request for this
BingKun Pan created SPARK-40162:
---
Summary: Upgrade RoaringBitmap from 0.9.30 to 0.9.31
Key: SPARK-40162
URL: https://issues.apache.org/jira/browse/SPARK-40162
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-40161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40161:
Assignee: Apache Spark
> Make Series.mode apply PandasMode
>
[
https://issues.apache.org/jira/browse/SPARK-40151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582482#comment-17582482
]
Apache Spark commented on SPARK-40151:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40161:
Assignee: (was: Apache Spark)
> Make Series.mode apply PandasMode
>
[
https://issues.apache.org/jira/browse/SPARK-40161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582483#comment-17582483
]
Apache Spark commented on SPARK-40161:
--
User 'zhengruifeng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582481#comment-17582481
]
Apache Spark commented on SPARK-40151:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40151:
Assignee: (was: Apache Spark)
> Fix return type for new median(interval) function
>
[
https://issues.apache.org/jira/browse/SPARK-40151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40151:
Assignee: Apache Spark
> Fix return type for new median(interval) function
>
Ruifeng Zheng created SPARK-40161:
-
Summary: Make Series.mode apply PandasMode
Key: SPARK-40161
URL: https://issues.apache.org/jira/browse/SPARK-40161
Project: Spark
Issue Type: Improvement
87 matches
Mail list logo
