L. C. Hsieh created SPARK-34297:
---
Summary: Add metrics for data loss and offset out range for
KafkaMicroBatchStream
Key: SPARK-34297
URL: https://issues.apache.org/jira/browse/SPARK-34297
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275519#comment-17275519
]
angerszhu commented on SPARK-34296:
---
Working on this
> AggregateWindowFunction#frame
Yuming Wang created SPARK-34296:
---
Summary: AggregateWindowFunction#frame should not always use
UnboundedPreceding
Key: SPARK-34296
URL: https://issues.apache.org/jira/browse/SPARK-34296
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275514#comment-17275514
]
Yuming Wang commented on SPARK-34296:
-
PostgrelSQL:
{noformat}
postgres@d40c1bcc8f5a
[
https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275492#comment-17275492
]
Yahui Liu commented on SPARK-34212:
---
Thanks for resolving this issue.
> For parquet t
[
https://issues.apache.org/jira/browse/SPARK-34270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-34270:
--
Fix Version/s: (was: 3.1.0)
3.1.1
> Combine StateStoreMetrics should no
[
https://issues.apache.org/jira/browse/SPARK-34270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-34270.
---
Fix Version/s: 2.4.8
3.0.2
3.1.0
Resolution: Fix
[
https://issues.apache.org/jira/browse/SPARK-34288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-34288:
--
Assignee: akiyamaneko
> Add a tip info for the `resources` column in the executors pa
[
https://issues.apache.org/jira/browse/SPARK-34288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-34288.
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31392
[https:
[
https://issues.apache.org/jira/browse/SPARK-34269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275458#comment-17275458
]
Apache Spark commented on SPARK-34269:
--
User 'sunchao' has created a pull request f
L. C. Hsieh created SPARK-34295:
---
Summary: Allow option similar to
mapreduce.job.hdfs-servers.token-renewal.exclude
Key: SPARK-34295
URL: https://issues.apache.org/jira/browse/SPARK-34295
Project: Spark
Holden Karau created SPARK-34294:
Summary: Add integration test for Spark dynamic allocation on Kube
w/graceful decommissioning
Key: SPARK-34294
URL: https://issues.apache.org/jira/browse/SPARK-34294
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Attachment: image-2021-01-30-00-34-05-946.png
> kubernetes executor pod unable to acce
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Description:
Steps to reproduce
# Configure secure HDFS(kerberos) cluster running as
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Attachment: image-2021-01-30-00-33-02-109.png
> kubernetes executor pod unable to acce
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Attachment: driver.log
> kubernetes executor pod unable to access secure hdfs
> --
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Attachment: executor.log
> kubernetes executor pod unable to access secure hdfs
>
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Description:
Steps to reproduce
# Configure secure HDFS(kerberos) cluster running as
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Attachment: image-2021-01-30-00-20-54-620.png
> kubernetes executor pod unable to acce
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Description:
Steps to reproduce
# Configure secure HDFS cluster running as containers
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Description:
Steps to reproduce
# Configure secure HDFS cluster running as containers
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Attachment: image-2021-01-30-00-14-14-329.png
> kubernetes executor pod unable to acce
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Attachment: image-2021-01-30-00-14-45-335.png
> kubernetes executor pod unable to acce
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Description:
Steps to reproduce
# Configure secure HDFS cluster running as containers
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Attachment: image-2021-01-30-00-13-18-234.png
> kubernetes executor pod unable to acce
[
https://issues.apache.org/jira/browse/SPARK-34293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manohar Chamaraju updated SPARK-34293:
--
Description:
Steps to reproduce
# Configure secure HDFS cluster running as containers
Manohar Chamaraju created SPARK-34293:
-
Summary: kubernetes executor pod unable to access secure hdfs
Key: SPARK-34293
URL: https://issues.apache.org/jira/browse/SPARK-34293
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-34289:
-
Assignee: Yuming Wang
> Vectorized reader support column index
> --
[
https://issues.apache.org/jira/browse/SPARK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-34289.
---
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31393
[https://
Gaelan Mines created SPARK-34292:
Summary: NOW is interpreted as the NOW SQL function
Key: SPARK-34292
URL: https://issues.apache.org/jira/browse/SPARK-34292
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-34285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274458#comment-17274458
]
Attila Zsolt Piros commented on SPARK-34285:
[~Xudingyu] predicate pushdown
[
https://issues.apache.org/jira/browse/SPARK-30420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274436#comment-17274436
]
Apache Spark commented on SPARK-30420:
--
User 'imback82' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274383#comment-17274383
]
Apache Spark commented on SPARK-34154:
--
User 'attilapiros' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-33163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274360#comment-17274360
]
Apache Spark commented on SPARK-33163:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luca Canali updated SPARK-34265:
Attachment: proposed_Python_SQLmetrics_v20210128.png
> Add SQLMetrics instrumentation to Python UD
[
https://issues.apache.org/jira/browse/SPARK-33599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274300#comment-17274300
]
Apache Spark commented on SPARK-33599:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-34291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274280#comment-17274280
]
Apache Spark commented on SPARK-34291:
--
User 'zhengruifeng' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-34291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274279#comment-17274279
]
Apache Spark commented on SPARK-34291:
--
User 'zhengruifeng' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-34291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34291:
Assignee: Apache Spark
> LSH hashDistance optimization
> -
>
[
https://issues.apache.org/jira/browse/SPARK-34291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34291:
Assignee: (was: Apache Spark)
> LSH hashDistance optimization
> -
zhengruifeng created SPARK-34291:
Summary: LSH hashDistance optimization
Key: SPARK-34291
URL: https://issues.apache.org/jira/browse/SPARK-34291
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-33601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-33601.
-
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31293
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274253#comment-17274253
]
Cristi commented on SPARK-34144:
[~hyukjin.kwon]Â shouldn't the fix version be 3.1.1 inst
[
https://issues.apache.org/jira/browse/SPARK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34289:
Assignee: Apache Spark
> Vectorized reader support column index
> ---
[
https://issues.apache.org/jira/browse/SPARK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274250#comment-17274250
]
Apache Spark commented on SPARK-34289:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34289:
Assignee: (was: Apache Spark)
> Vectorized reader support column index
>
[
https://issues.apache.org/jira/browse/SPARK-34290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274247#comment-17274247
]
Maxim Gekk commented on SPARK-34290:
I am working on this.
> Support v2 TRUNCATE TA
Maxim Gekk created SPARK-34290:
--
Summary: Support v2 TRUNCATE TABLE
Key: SPARK-34290
URL: https://issues.apache.org/jira/browse/SPARK-34290
Project: Spark
Issue Type: Sub-task
Componen
[
https://issues.apache.org/jira/browse/SPARK-34284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-34284:
Assignee: Yang Jie
> Fix deprecated API usage of commons-io
> ---
[
https://issues.apache.org/jira/browse/SPARK-34284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34284.
--
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31389
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-34144:
Assignee: Cristi
> java.time.Instant and java.time.LocalDate not handled when writing to
[
https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34144.
--
Fix Version/s: 3.1.2
3.0.2
Resolution: Fixed
Issue resolved by pull
Yuming Wang created SPARK-34289:
---
Summary: Vectorized reader support column index
Key: SPARK-34289
URL: https://issues.apache.org/jira/browse/SPARK-34289
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-34288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274227#comment-17274227
]
Apache Spark commented on SPARK-34288:
--
User 'akiyamaneko' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-34288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34288:
Assignee: (was: Apache Spark)
> Add a tip info for the `resources` column in the exec
[
https://issues.apache.org/jira/browse/SPARK-34288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34288:
Assignee: Apache Spark
> Add a tip info for the `resources` column in the executors page
[
https://issues.apache.org/jira/browse/SPARK-34288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274226#comment-17274226
]
Apache Spark commented on SPARK-34288:
--
User 'akiyamaneko' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-34288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
akiyamaneko updated SPARK-34288:
Description:
After upgrading from spark 2.3 to spark 3.0.1, the *Resources* column in the
executo
[
https://issues.apache.org/jira/browse/SPARK-34288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
akiyamaneko updated SPARK-34288:
Attachment: spark3-Resources-no-tip-info.png
> Add a tip info for the `resources` column in the ex
akiyamaneko created SPARK-34288:
---
Summary: Add a tip info for the `resources` column in the
executors page
Key: SPARK-34288
URL: https://issues.apache.org/jira/browse/SPARK-34288
Project: Spark
60 matches
Mail list logo
