This is an automated email from the ASF dual-hosted git repository.
hansva pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/hop.git
from c298966f25 parquet output code hardening and cleanup, fixes #2338
(#8537)
new 016f9bfdf2 Parquet input: read drifting numeric schemas and name the
column on conversion errors, fixes #3598
new 7a49e2fb38 Hardening parquet input and output, fixes #3598
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../pipeline/transforms/parquet-file-input.adoc | 87 +++-
.../pipeline/transforms/parquet-file-output.adoc | 50 +-
.../hop/parquet/transforms/input/ParquetInput.java | 2 +-
.../parquet/transforms/input/ParquetInputMeta.java | 92 ++--
.../transforms/input/ParquetRowConverter.java | 4 +-
.../parquet/transforms/input/ParquetStream.java | 28 +-
.../transforms/input/ParquetValueConverter.java | 469 +++++++++++-------
.../parquet/transforms/output/ParquetOutput.java | 85 +++-
.../transforms/output/ParquetWriteSupport.java | 113 ++++-
.../transforms/input/ParquetStreamTest.java | 171 +++++++
.../input/ParquetToHopTypeMatrixTest.java | 544 +++++++++++++++++++++
.../input/ParquetValueConverterTest.java | 64 ++-
.../output/HopToParquetTypeMatrixTest.java | 323 ++++++++++++
.../transforms/output/ParquetWriteSupportTest.java | 86 ++++
14 files changed, 1870 insertions(+), 248 deletions(-)
create mode 100644
plugins/tech/parquet/src/test/java/org/apache/hop/parquet/transforms/input/ParquetStreamTest.java
create mode 100644
plugins/tech/parquet/src/test/java/org/apache/hop/parquet/transforms/input/ParquetToHopTypeMatrixTest.java
create mode 100644
plugins/tech/parquet/src/test/java/org/apache/hop/parquet/transforms/output/HopToParquetTypeMatrixTest.java
