Chao Sun created SPARK-36511:
Summary: Remove ColumnIO once PARQUET-2050 is released in Parquet
1.13
Key: SPARK-36511
URL: https://issues.apache.org/jira/browse/SPARK-36511
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-34861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34861:
-
Comment: was deleted
(was: Synced with [~chengsu] offline and I will take over this JIRA.)
> Support
[
https://issues.apache.org/jira/browse/SPARK-36440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394529#comment-17394529
]
Chao Sun commented on SPARK-36440:
--
Hmm really? Spark 2.x support this? I'm not sure why Spark is still
[
https://issues.apache.org/jira/browse/SPARK-36317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17388204#comment-17388204
]
Chao Sun commented on SPARK-36317:
--
[~vsowrirajan]: the change is already reverted - are you still
[
https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36137:
-
Description:
At the moment {{getPartitionsByFilter}} in Hive shim only fallback to use
Chao Sun created SPARK-36137:
Summary: HiveShim always fallback to getAllPartitionsOf regardless
of whether directSQL is enabled in remote HMS
Key: SPARK-36137
URL: https://issues.apache.org/jira/browse/SPARK-36137
Chao Sun created SPARK-36136:
Summary: Move PruneFileSourcePartitionsSuite out of
org.apache.spark.sql.hive
Key: SPARK-36136
URL: https://issues.apache.org/jira/browse/SPARK-36136
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380326#comment-17380326
]
Chao Sun commented on SPARK-36128:
--
Thanks, I'm slightly inclined to reuse the existing config but
Chao Sun created SPARK-36131:
Summary: Refactor ParquetColumnIndexSuite
Key: SPARK-36131
URL: https://issues.apache.org/jira/browse/SPARK-36131
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380299#comment-17380299
]
Chao Sun commented on SPARK-36128:
--
[~hyukjin.kwon] you are right - I didn't know this config is
[
https://issues.apache.org/jira/browse/SPARK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380299#comment-17380299
]
Chao Sun edited comment on SPARK-36128 at 7/14/21, 4:24 AM:
[~hyukjin.kwon]
Chao Sun created SPARK-36128:
Summary: CatalogFileIndex.filterPartitions should respect
spark.sql.hive.metastorePartitionPruning
Key: SPARK-36128
URL: https://issues.apache.org/jira/browse/SPARK-36128
[
https://issues.apache.org/jira/browse/SPARK-36123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36123:
-
Labels: correctness (was: )
> Parquet vectorized reader doesn't skip null values correctly
>
Chao Sun created SPARK-36123:
Summary: Parquet vectorized reader doesn't skip null values
correctly
Key: SPARK-36123
URL: https://issues.apache.org/jira/browse/SPARK-36123
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-35743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35743:
-
Labels: parquet (was: )
> Improve Parquet vectorized reader
> -
>
>
Chao Sun created SPARK-36056:
Summary: Combine readBatch and readIntegers in
VectorizedRleValuesReader
Key: SPARK-36056
URL: https://issues.apache.org/jira/browse/SPARK-36056
Project: Spark
Chao Sun created SPARK-35959:
Summary: Add a new Maven profile "no-shaded-client" for older
Hadoop 3.x versions
Key: SPARK-35959
URL: https://issues.apache.org/jira/browse/SPARK-35959
Project: Spark
Chao Sun created SPARK-35867:
Summary: Enable vectorized read for
VectorizedPlainValuesReader.readBooleans
Key: SPARK-35867
URL: https://issues.apache.org/jira/browse/SPARK-35867
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-35846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35846:
-
Description: This is mostly refactoring work to complete SPARK-34859
> Introduce ParquetReadState to
Chao Sun created SPARK-35846:
Summary: Introduce ParquetReadState to track various states while
reading a Parquet column chunk
Key: SPARK-35846
URL: https://issues.apache.org/jira/browse/SPARK-35846
[
https://issues.apache.org/jira/browse/SPARK-35640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35640:
-
Parent: SPARK-35743
Issue Type: Sub-task (was: Improvement)
> Refactor Parquet vectorized
Chao Sun created SPARK-35743:
Summary: Improve Parquet vectorized reader
Key: SPARK-35743
URL: https://issues.apache.org/jira/browse/SPARK-35743
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-34861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361090#comment-17361090
]
Chao Sun commented on SPARK-34861:
--
Synced with [~chengsu] offline and I will take over this JIRA.
>
[
https://issues.apache.org/jira/browse/SPARK-35703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35703:
-
Description: Currently Spark has {{HashClusteredDistribution}} and
{{ClusteredDistribution}}. The only
Chao Sun created SPARK-35703:
Summary: Remove HashClusteredDistribution
Key: SPARK-35703
URL: https://issues.apache.org/jira/browse/SPARK-35703
Project: Spark
Issue Type: Improvement
Chao Sun created SPARK-35640:
Summary: Refactor Parquet vectorized reader to remove duplicated
code paths
Key: SPARK-35640
URL: https://issues.apache.org/jira/browse/SPARK-35640
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34859:
-
Priority: Critical (was: Major)
> Vectorized parquet reader needs synchronization among pages for
[
https://issues.apache.org/jira/browse/SPARK-34859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34859:
-
Labels: correctness (was: )
> Vectorized parquet reader needs synchronization among pages for column
[
https://issues.apache.org/jira/browse/SPARK-35461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348667#comment-17348667
]
Chao Sun commented on SPARK-35461:
--
Actually this also fails when turning off the vectorized reader:
Chao Sun created SPARK-35461:
Summary: Error when reading dictionary-encoded Parquet int column
when read schema is bigint
Key: SPARK-35461
URL: https://issues.apache.org/jira/browse/SPARK-35461
Project:
[
https://issues.apache.org/jira/browse/SPARK-35422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346448#comment-17346448
]
Chao Sun commented on SPARK-35422:
--
Thanks [~dongjoon]. I've opened a PR for the above failures:
Chao Sun created SPARK-35390:
Summary: Handle type coercion when resolving V2 functions
Key: SPARK-35390
URL: https://issues.apache.org/jira/browse/SPARK-35390
Project: Spark
Issue Type:
Chao Sun created SPARK-35389:
Summary: Analyzer should set progagateNull to false for magic
function invocation
Key: SPARK-35389
URL: https://issues.apache.org/jira/browse/SPARK-35389
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35384:
-
Issue Type: Improvement (was: Bug)
> Improve performance for InvokeLike.invoke
>
Chao Sun created SPARK-35384:
Summary: Improve performance for InvokeLike.invoke
Key: SPARK-35384
URL: https://issues.apache.org/jira/browse/SPARK-35384
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-35361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35361:
-
Priority: Minor (was: Major)
> Improve performance for ApplyFunctionExpression
>
[
https://issues.apache.org/jira/browse/SPARK-35361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35361:
-
Priority: Major (was: Minor)
> Improve performance for ApplyFunctionExpression
>
Chao Sun created SPARK-35361:
Summary: Improve performance for ApplyFunctionExpression
Key: SPARK-35361
URL: https://issues.apache.org/jira/browse/SPARK-35361
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35321:
-
Issue Type: Bug (was: Improvement)
> Spark 3.x can't talk to HMS 1.2.x and lower due to
[
https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17339946#comment-17339946
]
Chao Sun commented on SPARK-35321:
--
[~yumwang] I'm thinking of using
[
https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17339906#comment-17339906
]
Chao Sun commented on SPARK-35321:
--
[~xkrogen] yes that can help to solve the issue, but users need to
Chao Sun created SPARK-35321:
Summary: Spark 3.x can't talk to HMS 1.2.x and lower due to
get_all_functions Thrift API missing
Key: SPARK-35321
URL: https://issues.apache.org/jira/browse/SPARK-35321
[
https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35321:
-
Description:
https://issues.apache.org/jira/browse/HIVE-10319 introduced a new API
[
https://issues.apache.org/jira/browse/SPARK-35315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35315:
-
Priority: Minor (was: Major)
> Keep benchmark result consistent between spark-submit and SBT
>
Chao Sun created SPARK-35315:
Summary: Keep benchmark result consistent between spark-submit and
SBT
Key: SPARK-35315
URL: https://issues.apache.org/jira/browse/SPARK-35315
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-35281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35281:
-
Priority: Minor (was: Major)
> StaticInvoke should not apply boxing if return type is primitive
>
Chao Sun created SPARK-35281:
Summary: StaticInvoke should not apply boxing if return type is
primitive
Key: SPARK-35281
URL: https://issues.apache.org/jira/browse/SPARK-35281
Project: Spark
Chao Sun created SPARK-35261:
Summary: Support static invoke for stateless UDF
Key: SPARK-35261
URL: https://issues.apache.org/jira/browse/SPARK-35261
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-34981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34981:
-
Parent: SPARK-35260
Issue Type: Sub-task (was: Improvement)
> Implement V2 function resolution
Chao Sun created SPARK-35260:
Summary: DataSourceV2 Function Catalog implementation
Key: SPARK-35260
URL: https://issues.apache.org/jira/browse/SPARK-35260
Project: Spark
Issue Type: Umbrella
Chao Sun created SPARK-35233:
Summary: Switch from bintray to scala.jfrog.io for SBT download in
branch 2.4 and 3.0
Key: SPARK-35233
URL: https://issues.apache.org/jira/browse/SPARK-35233
Project: Spark
Chao Sun created SPARK-35232:
Summary: Nested column pruning should retain column metadata
Key: SPARK-35232
URL: https://issues.apache.org/jira/browse/SPARK-35232
Project: Spark
Issue Type: Bug
Chao Sun created SPARK-35195:
Summary: Move InMemoryTable etc to
org.apache.spark.sql.connector.catalog
Key: SPARK-35195
URL: https://issues.apache.org/jira/browse/SPARK-35195
Project: Spark
Chao Sun created SPARK-35003:
Summary: Improve performance for reading smallint in vectorized
Parquet reader
Key: SPARK-35003
URL: https://issues.apache.org/jira/browse/SPARK-35003
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316714#comment-17316714
]
Chao Sun commented on SPARK-34780:
--
Hi [~mikechen] (and sorry for the late reply again), thanks for
[
https://issues.apache.org/jira/browse/SPARK-34981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316477#comment-17316477
]
Chao Sun commented on SPARK-34981:
--
Will submit a PR soon.
> Implement V2 function resolution and
Chao Sun created SPARK-34981:
Summary: Implement V2 function resolution and evaluation
Key: SPARK-34981
URL: https://issues.apache.org/jira/browse/SPARK-34981
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34973:
-
Priority: Minor (was: Major)
> Cleanup unused fields and methods in vectorized Parquet reader
>
Chao Sun created SPARK-34973:
Summary: Cleanup unused fields and methods in vectorized Parquet
reader
Key: SPARK-34973
URL: https://issues.apache.org/jira/browse/SPARK-34973
Project: Spark
Chao Sun created SPARK-34947:
Summary: Streaming write to a V2 table should invalidate its
associated cache
Key: SPARK-34947
URL: https://issues.apache.org/jira/browse/SPARK-34947
Project: Spark
Chao Sun created SPARK-34945:
Summary: Fix Javadoc for catalyst module
Key: SPARK-34945
URL: https://issues.apache.org/jira/browse/SPARK-34945
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308854#comment-17308854
]
Chao Sun commented on SPARK-34780:
--
[~mikechen], yes you're right. I'm not sure if this is a big
[
https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308262#comment-17308262
]
Chao Sun commented on SPARK-34780:
--
Sorry for the late reply [~mikechen]! There's something I still not
[
https://issues.apache.org/jira/browse/SPARK-30497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308067#comment-17308067
]
Chao Sun commented on SPARK-30497:
--
[~cloud_fan] this is resolved right?
> migrate DESCRIBE TABLE to
[
https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305109#comment-17305109
]
Chao Sun commented on SPARK-34780:
--
Thanks for the reporting [~mikechen], the test case you provided is
[
https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-32703:
-
Description: Currently in {{SpecificParquetRecordReaderBase}} we use
deprecated APIs in a few places
[
https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-32703:
-
Summary: Replace deprecated API calls from SpecificParquetRecordReaderBase
(was: Enable dictionary
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290707#comment-17290707
]
Chao Sun commented on SPARK-33212:
--
Yes. I think the only class Spark needs from this jar is
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290613#comment-17290613
]
Chao Sun edited comment on SPARK-33212 at 2/25/21, 2:21 AM:
I was able to
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290613#comment-17290613
]
Chao Sun commented on SPARK-33212:
--
I was able to reproduce the error in my local environment, and find
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290127#comment-17290127
]
Chao Sun commented on SPARK-33212:
--
Thanks again [~ouyangxc.zte].
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289652#comment-17289652
]
Chao Sun commented on SPARK-33212:
--
Thanks for the details [~ouyangxc.zte]!
{quote}
Get AMIpFilter
[
https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289200#comment-17289200
]
Chao Sun commented on SPARK-33212:
--
Thanks for the report [~ouyangxc.zte]. Can you provide more
Chao Sun created SPARK-34419:
Summary: Move PartitionTransforms from java to scala directory
Key: SPARK-34419
URL: https://issues.apache.org/jira/browse/SPARK-34419
Project: Spark
Issue Type:
Chao Sun created SPARK-34347:
Summary: CatalogImpl.uncacheTable should invalidate in cascade for
temp views
Key: SPARK-34347
URL: https://issues.apache.org/jira/browse/SPARK-34347
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-34108.
--
Resolution: Duplicate
> Cache lookup doesn't work in certain cases
>
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34108:
-
Description:
Currently, caching a temporary or permenant view doesn't work in certain cases.
For
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34108:
-
Summary: Cache lookup doesn't work in certain cases (was: Caching with
permanent view doesn't work in
Chao Sun created SPARK-34271:
Summary: Use majorMinorPatchVersion for Hive version parsing
Key: SPARK-34271
URL: https://issues.apache.org/jira/browse/SPARK-34271
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273161#comment-17273161
]
Chao Sun commented on SPARK-27589:
--
[~xkrogen] FWIW I'm working on a POC for SPARK-32935 at the moment.
[
https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272333#comment-17272333
]
Chao Sun commented on SPARK-34052:
--
[~hyukjin.kwon] [~cloud_fan] do you think we should include this in
[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268063#comment-17268063
]
Chao Sun commented on SPARK-33507:
--
[~aokolnychyi] could you elaborate on the question? currently Spark
[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264608#comment-17264608
]
Chao Sun edited comment on SPARK-33507 at 1/14/21, 5:23 AM:
Thanks
[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264608#comment-17264608
]
Chao Sun commented on SPARK-33507:
--
Thanks [~hyukjin.kwon]. From my side, there is no regression.
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34108:
-
Summary: Caching with permanent view doesn't work in certain cases (was:
Caching doesn't work
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34108:
-
Description:
Currently, caching a permanent view doesn't work in certain cases. For
instance, in the
[
https://issues.apache.org/jira/browse/SPARK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34108:
-
Description:
Currently, caching a permanent view doesn't work in some cases. For instance,
in the
Chao Sun created SPARK-34108:
Summary: Caching doesn't work completely with permanent view
Key: SPARK-34108
URL: https://issues.apache.org/jira/browse/SPARK-34108
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-33311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-33311:
-
Parent: SPARK-33507
Issue Type: Sub-task (was: Improvement)
> Improve semantics for REFRESH
[
https://issues.apache.org/jira/browse/SPARK-34076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34076:
-
Affects Version/s: (was: 3.0.1)
3.1.0
> SQLContext.dropTempTable fails if
Chao Sun created SPARK-34076:
Summary: SQLContext.dropTempTable fails if cache is non-empty
Key: SPARK-34076
URL: https://issues.apache.org/jira/browse/SPARK-34076
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262826#comment-17262826
]
Chao Sun commented on SPARK-33507:
--
[~dongjoon], [~hyukjin.kwon]: can either of you remove me as
[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-33507:
-
Description:
This is an umbrella JIRA to track fixes & improvements for caching behavior in
Spark
[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-33507:
-
Description:
This is an umbrella JIRA to track fixes & improvements for caching behavior in
Spark
[
https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34052:
-
Parent: SPARK-33507
Issue Type: Sub-task (was: Bug)
> A cached view should become invalid
[
https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34052:
-
Parent: (was: SPARK-33392)
Issue Type: Bug (was: Sub-task)
> A cached view should become
[
https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34052:
-
Summary: A cached view should become invalid after a table is dropped
(was: A view doesn't become
[
https://issues.apache.org/jira/browse/SPARK-33729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-33729:
-
Parent: SPARK-33507
Issue Type: Sub-task (was: Bug)
> When refreshing cache, Spark should not
[
https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34052:
-
Affects Version/s: 3.1.0
> A view doesn't become invalid after a table is dropped or replaced in V2
>
[
https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34039:
-
Affects Version/s: 3.0.1
> [DSv2] ReplaceTable should invalidate cache
>
301 - 400 of 471 matches
Mail list logo