ostinru commented on issue #131: URL: https://github.com/apache/cloudberry-pxf/issues/131#issuecomment-5100640447
I run through PXF changelogs (only important features): ### Broadcom PXF 7.0 1. PXF external clusters (run PXF on dedicated hosts) 2. Remove support with Greenplum Database 5.x, RHEL 7, Hive 1.x and HBase 1.x. 3. Remove read and write support for Sequence Files for s3, abfss, wasbs, and gs profiles. ### Broadcom PXF 7.1 1. PXF now automatically deduplicates files received from HDFS-compatible systems to ensure consistent dataset results. This behavior is controlled by the new `pxf.hdfs.fragmenter.deduplicate` property in the `pxf-site.xml` per-server configuration file. When set to true (default), PXF removes duplicate files from the list. When set to false, the list of files is returned as is. 2. ✅ Tomcat 9.0.112 3. PXF supports table statistics gathering using the SQL ANALYZE command for the PXF foreign tables created using the pxf_fdw extension. 4. PXF supports TLS/SSL communication between PXF Greenplum extensions and PXF Services. ### Broadcom PXF 8.0 1. Java 17 is a minimal supported version 2. The PXF distribution bundles Hadoop 3.4.2 and Hive 3.1.3 client libraries. 3. The Spring Boot dependency is updated to version 3.5.13. 4. The Parquet dependency is updated to version 1.16.0. 5. The ORC dependency is updated to version 1.9.8. 6. The AWS SDK for Java dependency is updated to version 2.29.52. 7. The Tomcat dependency is updated to version 10.1.54. 8. ⚠️ PXF adds support for reading Iceberg tables with the pxf_fdw extension. PXF also supports predicate pushdown with Iceberg tables. 9. (ha-ha!) Removes support for HBase. ### Greengage PXF 6.16 1. Added support for reading and writing Iceberg-format data in Hive Metastore and REST catalogs (starting with Greengage DB 6.31.0) ### Arenadata PXF 6.x 1. ADBDEV-6581: Add integration with Vault service 2. ADBDEV-4665: Introduce write backpressure logic in pxf-jdbc 3. Implement reload and reloadAll methods for profiles 4. ADBDEV-5065: Add support for JSON and JSONB types for JDBC 5. ADBDEV-5746: Add an option to limit number of logical segments to execute external table query -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
