Re: [I] Support integration with Apache Paimon [incubator-xtable]

the-other-tim-brown commented on issue #275: URL: https://github.com/apache/incubator-xtable/issues/275#issuecomment-3237255908 I am re-opening this issue. We are still looking for contributors that are familiar with Paimon that can help us get started on this effort. -- This is an autom

[I] Support integration with Apache Paimon [incubator-xtable]

SteNicholas opened a new issue, #275: URL: https://github.com/apache/incubator-xtable/issues/275 Apache Paimon is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics. OneTable could adopt Paimon table format for stre

Re: [I] Support integration with Apache Paimon [incubator-xtable]

SteNicholas closed issue #275: Support integration with Apache Paimon URL: https://github.com/apache/incubator-xtable/issues/275 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] Support integration with Apache Paimon [incubator-xtable]

nickdelnano commented on issue #275: URL: https://github.com/apache/incubator-xtable/issues/275#issuecomment-3235658594 This still does not exist but would allow folks to leverage Paimon for its innovative write ingestion properties with LSM structure and then expose to other formats for r

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2299791136 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2299786638 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetSchemaExtractor.java: ## @@ -295,15 +298,23 @@ public InternalSchema toInternalSchema(Type schem

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2298443921 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetSchemaExtractor.java: ## @@ -295,15 +298,23 @@ public InternalSchema toInternalSchema(Type schem

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2298270154 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetSchemaExtractor.java: ## @@ -295,15 +298,23 @@ public InternalSchema toInternalSchema(T

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2298237068 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2298077680 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297196914 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297196914 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297196914 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297196914 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297185578 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetSchemaExtractor.java: ## @@ -295,15 +298,23 @@ public InternalSchema toInternalSchema(Type schem

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297177719 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297177719 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297174651 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297174651 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297170984 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetStatsExtractor.java: ## @@ -132,19 +181,23 @@ public static InternalDataFile toInterna

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297171855 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297012651 ## xtable-core/src/test/java/org/apache/xtable/parquet/TestParquetConversionSource.java: ## @@ -0,0 +1,434 @@ +/* + * Licensed to the Apache Software Foundati

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297011506 ## xtable-core/src/test/java/org/apache/xtable/parquet/TestSparkParquetTable.java: ## @@ -0,0 +1,117 @@ +/* + * Licensed to the Apache Software Foundation (AS

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2297011132 ## xtable-core/src/main/java/org/apache/xtable/hudi/HudiPathUtils.java: ## @@ -28,4 +28,8 @@ public static String getPartitionPath(Path tableBasePath, Path f

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2296989047 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetStatsExtractor.java: ## @@ -112,17 +119,59 @@ public static Map> getStatsForFile(ParquetMet

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2296985232 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetStatsExtractor.java: ## @@ -132,19 +181,23 @@ public static InternalDataFile toInternalDataFile

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2296924772 ## xtable-core/src/test/java/org/apache/xtable/parquet/TestParquetConversionSource.java: ## @@ -0,0 +1,434 @@ +/* + * Licensed to the Apache Software

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2296889636 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergDataFileUpdatesSync.java: ## @@ -113,7 +113,10 @@ private DataFile getDataFile( .wi

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2296881609 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergDataFileUpdatesSync.java: ## @@ -113,7 +113,10 @@ private DataFile getDataFile(

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2296841187 ## xtable-core/src/main/java/org/apache/xtable/hudi/BaseFileUpdatesExtractor.java: ## @@ -230,13 +230,14 @@ private WriteStatus toWriteStatus( writeStat.

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2296840281 ## xtable-core/src/main/java/org/apache/xtable/hudi/BaseFileUpdatesExtractor.java: ## @@ -230,13 +230,14 @@ private WriteStatus toWriteStatus( writeStat.

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2296839704 ## xtable-core/src/main/java/org/apache/xtable/hudi/BaseFileUpdatesExtractor.java: ## @@ -230,13 +230,14 @@ private WriteStatus toWriteStatus( w

[PR] Bump actions/setup-java from 4 to 5 [incubator-xtable]

dependabot[bot] opened a new pull request, #740: URL: https://github.com/apache/incubator-xtable/pull/740 Bumps [actions/setup-java](https://github.com/actions/setup-java) from 4 to 5. Release notes Sourced from https://github.com/actions/setup-java/releases";>actions/setup-java's

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2291336291 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schema, long t

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2289668271 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetConversionSource.java: ## @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Fou

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2289667725 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schem

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2288476830 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetConversionSource.java: ## @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation (

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2288471926 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetConversionSource.java: ## @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation (

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2288370925 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetPartitionSpecExtractor.java: ## @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286819249 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetPartitionSpecExtractor.java: ## @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2288338409 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetSchemaExtractor.java: ## @@ -270,12 +267,11 @@ public InternalSchema toInternalSchema(Type schem

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2287930246 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schema, long t

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2287930246 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schema, long t

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286819249 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetPartitionSpecExtractor.java: ## @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286819249 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetPartitionSpecExtractor.java: ## @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286796733 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schema, long t

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286796733 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schema, long t

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286797711 ## xtable-core/src/main/java/org/apache/xtable/hudi/PathBasedPartitionValuesExtractor.java: ## @@ -81,40 +77,40 @@ public List extractPartitionValues( }

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286796733 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schema, long t

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286784251 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schem

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286779877 ## xtable-core/src/test/java/org/apache/xtable/ITConversionController.java: ## @@ -188,6 +306,10 @@ private ConversionSourceProvider getConversionSourceProvi

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286779877 ## xtable-core/src/test/java/org/apache/xtable/ITConversionController.java: ## @@ -188,6 +306,10 @@ private ConversionSourceProvider getConversionSourceProvi

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286778531 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286775494 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schema, long t

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286774844 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetConversionSource.java: ## @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation (

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286774844 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetConversionSource.java: ## @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation (

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286772392 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schem

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286769539 ## xtable-core/src/main/java/org/apache/xtable/delta/DeltaStatsExtractor.java: ## @@ -111,6 +114,10 @@ public String convertStatsToDeltaFormat( .

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286768972 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schema, long t

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286724127 ## xtable-core/src/main/java/org/apache/xtable/iceberg/IcebergColumnStatsConverter.java: ## @@ -68,12 +72,28 @@ public Metrics toIceberg(Schema schem

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2286714881 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2281043317 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2281043317 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[I] Nested column partition support in HudiPartitionValuesExtractor when hive style partitioning is enabled [incubator-xtable]

kroushan-nit opened a new issue, #739: URL: https://github.com/apache/incubator-xtable/issues/739 ### Feature Request / Improvement XTable sync fails with number format exception when partitioning is done on a nested field and hive style partitioning is enabled - ```java jav

[PR] Nested column partition support in HudiPartitionValuesExtractor when hive style partitioning is enabled [incubator-xtable]

kroushan-nit opened a new pull request, #738: URL: https://github.com/apache/incubator-xtable/pull/738 ## *Important Read* - *Please ensure the GitHub issue is mentioned at the beginning of the PR* ## What is the purpose of the pull request XTable sync fails with number f

[PR] Bump actions/checkout from 4 to 5 [incubator-xtable]

dependabot[bot] opened a new pull request, #737: URL: https://github.com/apache/incubator-xtable/pull/737 Bumps [actions/checkout](https://github.com/actions/checkout) from 4 to 5. Release notes Sourced from https://github.com/actions/checkout/releases";>actions/checkout's releases

[I] Missing org.openjdk.jol from imported dependencies in xtable-utilities makes it to fail with NoClassDefFoundError [incubator-xtable]

ssandona opened a new issue, #736: URL: https://github.com/apache/incubator-xtable/issues/736 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/incubator-xtable/issues?q=is%3Aissue) and found no similar issues. ### Please describe the

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#issuecomment-3193718838 @the-other-tim-brown do you know this error in Hudi? `Failed to retrieve list of partition from metadata org.apache.hudi.exception.HoodieException: Exception when reading log fi

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2277174277 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2277174277 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2277174277 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2276806615 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2276806615 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2276704579 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundat

Re: [I] Trino fails to start in demo [incubator-xtable]

hz-git commented on issue #390: URL: https://github.com/apache/incubator-xtable/issues/390#issuecomment-3182711796 Hi，have you resolved this issue? I have encountered the same PR as you, But I do not know how to resolve this PR. -- This is an automated message from the Apache Git Service

Re: [PR] Update community sync page [incubator-xtable]

the-other-tim-brown commented on PR #734: URL: https://github.com/apache/incubator-xtable/pull/734#issuecomment-3181905959 Thanks @pratyakshsharma , I have reviewed and merged the PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] Update community sync page [incubator-xtable]

the-other-tim-brown merged PR #734: URL: https://github.com/apache/incubator-xtable/pull/734 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2270008127 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2270480798 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2270008127 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269892034 ## xtable-core/src/main/java/org/apache/xtable/reflection/ReflectionUtils.java: ## @@ -43,17 +44,31 @@ public static T createInstanceOfClass(String className

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269892034 ## xtable-core/src/main/java/org/apache/xtable/reflection/ReflectionUtils.java: ## @@ -43,17 +44,31 @@ public static T createInstanceOfClass(String className

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269877016 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269843361 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269836582 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269815795 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269815795 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269789141 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269611465 ## xtable-core/src/main/java/org/apache/xtable/reflection/ReflectionUtils.java: ## @@ -43,17 +44,31 @@ public static T createInstanceOfClass(String className

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269608946 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269603275 ## xtable-core/src/main/java/org/apache/xtable/reflection/ReflectionUtils.java: ## @@ -43,17 +44,31 @@ public static T createInstanceOfClass(String

Re: [PR] parquet source with partition extraction [incubator-xtable]

the-other-tim-brown commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2269590838 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetParitionUtil.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] Update community sync page [incubator-xtable]

pratyakshsharma commented on PR #734: URL: https://github.com/apache/incubator-xtable/pull/734#issuecomment-3173767010 @the-other-tim-brown can we assign someone to review this? I am still new to xtable community and not sure about the review process here. -- This is an automated message

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#issuecomment-3160290652 @the-other-tim-brown could you check with me why the syncs are failing for all 3 formats? -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2256574161 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetConversionSource.java: ## @@ -0,0 +1,255 @@ +/* + * Licensed to the Apache Software Foundation (

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#issuecomment-3158619926 for Parquet syncing, a generic table (xtable-core/src/test/java/org/apache/xtable/GenericTable.java) has to be specific to Parquet or I may use Hudi's code for that? -- This

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#issuecomment-3155917966 @the-other-tim-brown the test class should create the files using a spark session ? -- This is an automated message from the Apache Git Service. To respond to the message, ple

[I] Ability to pass configuration credentials via REST api [incubator-xtable]

J4cku opened a new issue, #735: URL: https://github.com/apache/incubator-xtable/issues/735 ### Feature Request / Improvement Today it's impossible to pass Hadoop/aws/spark properties via REST API. I would love to be able to deploy xtable REST API and be able to pass some variables

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2251769813 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetConversionSource.java: ## @@ -0,0 +1,255 @@ +/* + * Licensed to the Apache Software Foundation (

Re: [PR] parquet source with partition extraction [incubator-xtable]

unical1988 commented on code in PR #728: URL: https://github.com/apache/incubator-xtable/pull/728#discussion_r2251747616 ## xtable-core/src/main/java/org/apache/xtable/parquet/ParquetConversionSource.java: ## @@ -0,0 +1,255 @@ +/* + * Licensed to the Apache Software Foundation (

  1   2   3   4   5   6   7   8   9   10   >