[
https://issues.apache.org/jira/browse/SPARK-38011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-38011:
---
Assignee: yikf
> Remove useless and duplicated configuration in ParquetFileFormat builderRe
[
https://issues.apache.org/jira/browse/SPARK-38011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-38011.
-
Resolution: Fixed
Issue resolved by pull request 35308
[https://github.com/apache/spark/pull/353
[
https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482851#comment-17482851
]
LLiu edited comment on SPARK-38033 at 1/27/22, 6:35 AM:
[
https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482851#comment-17482851
]
LLiu edited comment on SPARK-38033 at 1/27/22, 6:24 AM:
[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-38040.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35339
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-38040:
Assignee: Hyukjin Kwon
> Enable binary compatibility check for APIs in Catalyst, KVStore
Jackey Lee created SPARK-38041:
--
Summary: DataFilter pushed down with PartitionFilter
Key: SPARK-38041
URL: https://issues.apache.org/jira/browse/SPARK-38041
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-36872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482861#comment-17482861
]
Abhishek Rao commented on SPARK-36872:
--
[~shkhrgpt], could you please share more de
[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482855#comment-17482855
]
Apache Spark commented on SPARK-38040:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-38040:
-
Description:
{code}
./dev/mima
{code}
We don't currently run binary compatibility check in belo
[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482854#comment-17482854
]
Apache Spark commented on SPARK-38040:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38040:
Assignee: (was: Apache Spark)
> Enable binary compatibility check for APIs in Catalys
[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38040:
Assignee: Apache Spark
> Enable binary compatibility check for APIs in Catalyst, KVStore
[
https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
LLiu updated SPARK-38033:
-
Summary: The structured streaming processing cannot be started because the
commitId and offsetId are inc
[
https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482851#comment-17482851
]
LLiu commented on SPARK-38033:
--
Yes, I found the same code in Spark 3+. But I didn'
Hyukjin Kwon created SPARK-38040:
Summary: Enable binary compatibility check for APIs in Catalyst,
KVStore and Avro modules
Key: SPARK-38040
URL: https://issues.apache.org/jira/browse/SPARK-38040
Proj
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482845#comment-17482845
]
Prakhar Jain edited comment on SPARK-37980 at 1/27/22, 2:55 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482845#comment-17482845
]
Prakhar Jain edited comment on SPARK-37980 at 1/27/22, 2:55 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482845#comment-17482845
]
Prakhar Jain commented on SPARK-37980:
--
[~cloud_fan] I did some more investigation
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhou xiang updated SPARK-38034:
---
Description:
TransposeWindow rule will try to eliminate unnecessary shuffle:
{code:java}
/**
* Tran
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482832#comment-17482832
]
Apache Spark commented on SPARK-38034:
--
User 'constzhou' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38034:
Assignee: Apache Spark
> Optimize time complexity and extend applicable cases for Transpo
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482831#comment-17482831
]
Apache Spark commented on SPARK-38034:
--
User 'constzhou' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38034:
Assignee: (was: Apache Spark)
> Optimize time complexity and extend applicable cases
[
https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482829#comment-17482829
]
Hyukjin Kwon commented on SPARK-38033:
--
Spark 2.4 is EOL so no bug fixes will likel
[
https://issues.apache.org/jira/browse/SPARK-38038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-38038:
-
Labels: (was: bulk-closed)
> DataSourceV2 OrcTable can't support read partition doesn't contai
[
https://issues.apache.org/jira/browse/SPARK-38038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-38038:
-
Priority: Major (was: Critical)
> DataSourceV2 OrcTable can't support read partition doesn't co
[
https://issues.apache.org/jira/browse/SPARK-37994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482824#comment-17482824
]
Vu Tan commented on SPARK-37994:
[~csun]
Thank you for your reply.
And I have confirm
[
https://issues.apache.org/jira/browse/SPARK-36476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482814#comment-17482814
]
Hyukjin Kwon commented on SPARK-36476:
--
Thanks man. Let's get this done in cloudpic
[
https://issues.apache.org/jira/browse/SPARK-37948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482813#comment-17482813
]
hujiahua commented on SPARK-37948:
--
Well, your explanation does make sense.
> Disable
[
https://issues.apache.org/jira/browse/SPARK-36476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482308#comment-17482308
]
Pedro Larroy edited comment on SPARK-36476 at 1/26/22, 9:59 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-37934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482734#comment-17482734
]
Apache Spark commented on SPARK-37934:
--
User 'JackBuggins' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482686#comment-17482686
]
Erik Krogen commented on SPARK-38030:
-
[~shardulm] can you also comment on why the e
[
https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37840:
Assignee: (was: Apache Spark)
> Dynamically update the loaded Hive UDF JAR
>
[
https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482684#comment-17482684
]
Apache Spark commented on SPARK-37840:
--
User 'iRakson' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37840:
Assignee: Apache Spark
> Dynamically update the loaded Hive UDF JAR
> ---
[
https://issues.apache.org/jira/browse/SPARK-37934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482668#comment-17482668
]
Jack commented on SPARK-37934:
--
This still impacts the 3.2 stream in 3.2.0, 3.2.1, are ther
[
https://issues.apache.org/jira/browse/SPARK-37936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482647#comment-17482647
]
Apache Spark commented on SPARK-37936:
--
User 'senthh' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-37936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482646#comment-17482646
]
Apache Spark commented on SPARK-37936:
--
User 'senthh' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-37994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482632#comment-17482632
]
Chao Sun commented on SPARK-37994:
--
[~tanvu] Hmm in that case maybe you can try:
{code}
[
https://issues.apache.org/jira/browse/SPARK-30062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao reassigned SPARK-30062:
--
Assignee: Ivan Karol
> bug with DB2Driver using mode("overwrite") option("truncate",True)
> -
[
https://issues.apache.org/jira/browse/SPARK-38038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ShiHang Gao updated SPARK-38038:
Summary: DataSourceV2 OrcTable can't support read partition doesn't
contains "=" (was: DataSource
[
https://issues.apache.org/jira/browse/SPARK-38038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ShiHang Gao updated SPARK-38038:
Description:
I want to use DataSource V2 OrcTable to read a Hive partitioned table, The
directory
[
https://issues.apache.org/jira/browse/SPARK-38038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ShiHang Gao updated SPARK-38038:
Description:
I want to use DataSource V2 ORCTable to read a Hive partitioned table, The
directory
[
https://issues.apache.org/jira/browse/SPARK-38038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ShiHang Gao updated SPARK-38038:
Affects Version/s: 3.0.1
(was: 2.4.3)
Description:
I want to
[
https://issues.apache.org/jira/browse/SPARK-38039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitry Lapshin updated SPARK-38039:
---
Description:
Consider this code in Scala:
{code:scala}
case class DemoSubRow(a: Int, b: Arra
Dmitry Lapshin created SPARK-38039:
--
Summary: From Scala/Java API, higher-level functions (like exists)
produce wrong expressions when nested
Key: SPARK-38039
URL: https://issues.apache.org/jira/browse/SPARK-3803
ShiHang Gao created SPARK-38038:
---
Summary: DataSourceV2 ORCTable can't read partition doesn't
contains "="
Key: SPARK-38038
URL: https://issues.apache.org/jira/browse/SPARK-38038
Project: Spark
RJ created SPARK-38037:
--
Summary: Spark MLlib FPGrowth not working with 40+ items in
Frequent Item set
Key: SPARK-38037
URL: https://issues.apache.org/jira/browse/SPARK-38037
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482520#comment-17482520
]
Vu Tan commented on SPARK-37994:
[~csun]
I checked you PR
[https://github.com/apache
[
https://issues.apache.org/jira/browse/SPARK-38008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-38008:
-
Issue Type: Improvement (was: Bug)
Priority: Trivial (was: Major)
Not sure why this is m
[ https://issues.apache.org/jira/browse/SPARK-38035 ]
jiaan.geng deleted comment on SPARK-38035:
was (Author: beliefer):
I'm working on.
> Add docker tests for build-in JDBC dialect
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-38036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482435#comment-17482435
]
Apache Spark commented on SPARK-38036:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482434#comment-17482434
]
Apache Spark commented on SPARK-38036:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38036:
Assignee: Apache Spark
> Refactor `VersionsSuite` as a subclass of `HiveVersionSuite`
> -
[
https://issues.apache.org/jira/browse/SPARK-38036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38036:
Assignee: (was: Apache Spark)
> Refactor `VersionsSuite` as a subclass of `HiveVersio
Yang Jie created SPARK-38036:
Summary: Refactor `VersionsSuite` as a subclass of
`HiveVersionSuite`
Key: SPARK-38036
URL: https://issues.apache.org/jira/browse/SPARK-38036
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-34807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482409#comment-17482409
]
Apache Spark commented on SPARK-34807:
--
User 'constzhou' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-34807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482408#comment-17482408
]
Apache Spark commented on SPARK-34807:
--
User 'constzhou' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38035:
Assignee: Apache Spark
> Add docker tests for build-in JDBC dialect
> ---
[
https://issues.apache.org/jira/browse/SPARK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482401#comment-17482401
]
Apache Spark commented on SPARK-38035:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482400#comment-17482400
]
Apache Spark commented on SPARK-38035:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38035:
Assignee: (was: Apache Spark)
> Add docker tests for build-in JDBC dialect
>
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhou xiang updated SPARK-38034:
---
Description:
TransposeWindow rule will try to eliminate unnecessary shuffle:
{code:java}
/**
* Tran
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhou xiang updated SPARK-38034:
---
Description:
TransposeWindow rule will try to eliminate unnecessary shuffle:
{code:java}
/**
* Tran
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhou xiang updated SPARK-38034:
---
Description:
{code:java}
val df = spark.range(10).selectExpr("id AS a", "id AS b", "id
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhou xiang updated SPARK-38034:
---
Description:
{code:java}
val df = spark.range(10).selectExpr("id AS a", "id AS b", "id AS c", "id
jiaan.geng created SPARK-38035:
--
Summary: Add docker tests for build-in JDBC dialect
Key: SPARK-38035
URL: https://issues.apache.org/jira/browse/SPARK-38035
Project: Spark
Issue Type: New Featur
[
https://issues.apache.org/jira/browse/SPARK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482395#comment-17482395
]
jiaan.geng commented on SPARK-38035:
I'm working on.
> Add docker tests for build-i
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhou xiang updated SPARK-38034:
---
Description:
{code:java}
val df = spark.range(10).selectExpr("id AS a", "id AS b", "id AS c", "id
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhou xiang updated SPARK-38034:
---
Description:
{code:java}
val df = spark.range(10).selectExpr("id AS a", "id AS b", "id AS c", "id
[
https://issues.apache.org/jira/browse/SPARK-38034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhou xiang updated SPARK-38034:
---
Description:
{code:java}
val df = spark.range(10).selectExpr("id AS a", "id AS b", "id AS c", "id
zhou xiang created SPARK-38034:
--
Summary: Optimize time complexity and extend applicable cases for
TransposeWindow
Key: SPARK-38034
URL: https://issues.apache.org/jira/browse/SPARK-38034
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38029.
---
Fix Version/s: 3.3.0
Assignee: William Hyun
Resolution: Fixed
This is resolv
[
https://issues.apache.org/jira/browse/SPARK-38029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38029:
--
Summary: Support docker-desktop K8S integration test in SBT (was: Support
K8S integration tes
LLiu created SPARK-38033:
Summary: The structured streaming processing cannot be started
because the commit and offset are inconsistent
Key: SPARK-38033
URL: https://issues.apache.org/jira/browse/SPARK-38033
[
https://issues.apache.org/jira/browse/SPARK-37999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Petri closed SPARK-37999.
-
> Spark executor self-exiting due to driver disassociated in Kubernetes
> --
[
https://issues.apache.org/jira/browse/SPARK-37999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Petri resolved SPARK-37999.
---
Resolution: Not A Bug
> Spark executor self-exiting due to driver disassociated in Kubernetes
>
[
https://issues.apache.org/jira/browse/SPARK-37537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Petri resolved SPARK-37537.
---
Resolution: Not A Problem
> Spark 3.2.0 driver pod does not mount checkpoint filesystem from Kubernetes
> P
[
https://issues.apache.org/jira/browse/SPARK-37537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Petri closed SPARK-37537.
-
> Spark 3.2.0 driver pod does not mount checkpoint filesystem from Kubernetes
> PVC
> -
80 matches
Mail list logo
