[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2023-07-05 Thread Vinoth Chandar (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar updated HUDI-3532:
-
Epic Link: HUDI-6243  (was: HUDI-1822)

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: code-quality, writer-core
>Reporter: Ethan Guo
>Priority: Minor
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-08-16 Thread Sagar Sumit (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sagar Sumit updated HUDI-3532:
--
Fix Version/s: 0.12.1
   (was: 0.12.0)

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: code-quality, writer-core
>Reporter: Ethan Guo
>Priority: Minor
> Fix For: 0.12.1
>
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-04-25 Thread Raymond Xu (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3532:
-
Priority: Minor  (was: Blocker)

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: code-quality, writer-core
>Reporter: Ethan Guo
>Priority: Minor
> Fix For: 0.12.0
>
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-04-18 Thread Ethan Guo (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Guo updated HUDI-3532:

Priority: Blocker  (was: Major)

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: code-quality, writer-core
>Reporter: Ethan Guo
>Priority: Blocker
> Fix For: 0.12.0
>
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-03-29 Thread Raymond Xu (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3532:
-
Issue Type: Improvement  (was: Task)

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: writer-core
>Reporter: Ethan Guo
>Priority: Major
> Fix For: 0.12.0
>
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-03-29 Thread Raymond Xu (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3532:
-
Fix Version/s: 0.12.0
   (was: 0.11.0)

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Task
>  Components: writer-core
>Reporter: Ethan Guo
>Priority: Major
> Fix For: 0.12.0
>
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-03-29 Thread Raymond Xu (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-3532:
-
Component/s: code-quality

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Improvement
>  Components: code-quality, writer-core
>Reporter: Ethan Guo
>Priority: Major
> Fix For: 0.12.0
>
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-03-01 Thread sivabalan narayanan (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sivabalan narayanan updated HUDI-3532:
--
Component/s: writer-core

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Task
>  Components: writer-core
>Reporter: Ethan Guo
>Priority: Major
> Fix For: 0.11.0
>
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-02-28 Thread Ethan Guo (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Guo updated HUDI-3532:

Description: 
The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
{code:java}
@Override
  public Map, HoodieMetadataColumnStats> 
getColumnStats(final List> partitionNameFileNameList, 
final String columnName)
  throws HoodieMetadataException {
throw new HoodieMetadataException("Unsupported operation: 
getColumnsStats!");
  } {code}
It's better to support column stats without metadata table from 
FileSystemBackedTableMetadata as well to unify the logic around col stats and 
reduce the special-cased logic for col stats between metadata table vs file 
system backed metadata.

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Ethan Guo
>Priority: Major
> Fix For: 0.11.0
>
>
> The api {{getColumnStats}} is not supported in FileSystemBackedTableMetadata:
> {code:java}
> @Override
>   public Map, HoodieMetadataColumnStats> 
> getColumnStats(final List> partitionNameFileNameList, 
> final String columnName)
>   throws HoodieMetadataException {
> throw new HoodieMetadataException("Unsupported operation: 
> getColumnsStats!");
>   } {code}
> It's better to support column stats without metadata table from 
> FileSystemBackedTableMetadata as well to unify the logic around col stats and 
> reduce the special-cased logic for col stats between metadata table vs file 
> system backed metadata.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-02-28 Thread Ethan Guo (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Guo updated HUDI-3532:

Fix Version/s: 0.11.0

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Ethan Guo
>Priority: Blocker
> Fix For: 0.11.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (HUDI-3532) Refactor FileSystemBackedTableMetadata and related classes to support getColumnStats directly

2022-02-28 Thread Ethan Guo (Jira) 


 [ 
https://issues.apache.org/jira/browse/HUDI-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ethan Guo updated HUDI-3532:

Priority: Major  (was: Blocker)

> Refactor FileSystemBackedTableMetadata and related classes to support 
> getColumnStats directly
> -
>
> Key: HUDI-3532
> URL: https://issues.apache.org/jira/browse/HUDI-3532
> Project: Apache Hudi
>  Issue Type: Task
>Reporter: Ethan Guo
>Priority: Major
> Fix For: 0.11.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)