This is an automated email from the ASF dual-hosted git repository.
juri pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git
from f05a09fc0 Merge pull request #639 from zkaoudi/main
add afb8e413c Ported object-file IO onto a safe codec to mitigate gadget
chain attack that runs arbitrary bytecode inside the Wayang JVM
add 0d640ddbb updated to a centralized warning
add f0bc5f149 Switch JavaObjectFileSourceTest to legacy serialization
fixture
add 81658cf0e Switch JavaObjectFileSourceTest to legacy serialization
fixture
add 6189abbe8 SparkObjectFileSource now just relies on
ObjectFileSource#getSerializationMode and SparkObjectFileSink.encodeBuffer to
inline the BytesWritable construction for readability
new b893e2cfd Merge pull request #640 from
2pk03/feature/object-file-serialization
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
wayang-api/wayang-api-python/pom.xml | 21 ++++
.../basic/operators/ObjectFileSerialization.java | 139 +++++++++++++++++++++
.../operators/ObjectFileSerializationMode.java} | 19 +--
.../wayang/basic/operators/ObjectFileSink.java | 39 ++++++
.../wayang/basic/operators/ObjectFileSource.java | 36 ++++++
.../operators/ObjectFileSerializationTest.java | 79 ++++++++++++
.../flink/compiler/WayangFileOutputFormat.java | 25 ++--
.../flink/operators/FlinkObjectFileSink.java | 7 +-
.../flink/operators/FlinkObjectFileSource.java | 11 +-
.../wayang/java/operators/JavaObjectFileSink.java | 17 +--
.../java/operators/JavaObjectFileSource.java | 51 ++++----
.../java/operators/JavaObjectFileSourceTest.java | 1 +
.../spark/operators/SparkObjectFileSink.java | 54 +++++++-
.../spark/operators/SparkObjectFileSource.java | 21 +++-
.../spark/operators/SparkObjectFileSourceTest.java | 1 +
15 files changed, 451 insertions(+), 70 deletions(-)
create mode 100644
wayang-commons/wayang-basic/src/main/java/org/apache/wayang/basic/operators/ObjectFileSerialization.java
copy
wayang-commons/{wayang-core/src/main/java/org/apache/wayang/core/platform/ExecutionResource.java
=>
wayang-basic/src/main/java/org/apache/wayang/basic/operators/ObjectFileSerializationMode.java}
(62%)
create mode 100644
wayang-commons/wayang-basic/src/test/java/org/apache/wayang/basic/operators/ObjectFileSerializationTest.java
