This is an automated email from the ASF dual-hosted git repository.
zkaoudi pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git
from 7742d2a6 Merge pull request #518 from mspruc/main
add a918e00b cloud implementations test
add d3182a15 Refactor Benchmark Main and WordCount to normal appearance
add 01fe79b3 Add AWS and JSON library to pom file
add 34f641f7 Add implementations for Amazon and Google Cloud operators
add d32fd51a Add tests and amazon s3 source refactor
add cf6ca527 add implementations
add 959cbb47 fixed GoogleCloudStorage Operator
add a07ce9e5 Remove throw declartion from cunstroctur in AmazonS3Source
add c265eb49 Add Mappin from AmazonS3Source to JavaAmazonS3Source and add
implementation for JavaAmazonS3Source
add 3669bdeb Added JavaGoogleCloudSourceSTorage and according mapping
add f32295a7 removed IOException in the googleClourSOurce Operator
add 31caf04c removed fileURL as param from GCS
add e7c84ffe removed inputURL param from AWS3 Source
add bd09360c implemented GCS and AWS3 to JavaPLanBuilder and PlanBuilder
add 4d09956a commented out tests for GCS and AS3
add 47a3939e added GCS and AS3 to imports
add 1a04880d clean install works
add aa4f1f52 updated getSupportedOutputChannels method
add 71eec3da update files with methods to override
add a6a74a76 added stack trace prints
add 84a9ef94 updated logger and configuration path
add 0bb65590 updated config wayang-java for AS3 and GCS
add be834baa updated tests
add 2aa70ba9 Add implementation for Azure and refactor S3
add 1731ac71 fix bugs in scala files
add 538bb031 Merge remote-tracking branch
'origin/addimplementationforazure'
add d0fe2d0c Merge branch 'apache:main' into main
add 25fadd6d fixed license issues
add 859d147c Merge branch 'apache:main' into main
add 9c760b4f Update file to use current implementaion from
apache/incubator-wayang
add 00f85488 remove unused files - created for testing source operators
add 31f69813 align WordCount with as-is from main apache/incubator-wayang
repository
add bf0e31d2 remove unused tests - test for cloud operators will always
fail on other people computers as credentials can not be added to git
add 7a8dd187 cleanup file, removes prints and todo comments
add 3a461b51 Merge pull request #524 from ChristofferKristensen/main
No new revisions were added by this update.
Summary of changes:
LICENSE | 9 +
NOTICE | 7 +-
pom.xml | 13 +-
.../org/apache/wayang/api/JavaPlanBuilder.scala | 35 +-
.../scala/org/apache/wayang/api/PlanBuilder.scala | 34 +-
.../org/apache/wayang/apps/wordcount/Main.java | 7 +-
.../apache/wayang/apps/wordcount/WordCount.java | 125 ++++---
wayang-commons/wayang-basic/pom.xml | 63 ++++
.../wayang/basic/operators/AmazonS3Source.java | 327 +++++++++++++++++++
.../basic/operators/AzureBlobStorageSource.java | 359 +++++++++++++++++++++
.../basic/operators/GoogleCloudStorageSource.java | 262 +++++++++++++++
...urceMapping.java => AmazonS3SourceMapping.java} | 28 +-
...ing.java => AzureBlobStorageSourceMapping.java} | 29 +-
...g.java => GoogleCloudStorageSourceMapping.java} | 33 +-
.../org/apache/wayang/java/mapping/Mappings.java | 5 +-
...fkaTopicSource.java => JavaAmazonS3Source.java} | 104 +++---
...Source.java => JavaAzureBlobStorageSource.java} | 102 +++---
...urce.java => JavaGoogleCloudStorageSource.java} | 128 ++++----
.../main/resources/wayang-java-defaults.properties | 64 ++++
19 files changed, 1431 insertions(+), 303 deletions(-)
create mode 100644
wayang-commons/wayang-basic/src/main/java/org/apache/wayang/basic/operators/AmazonS3Source.java
create mode 100644
wayang-commons/wayang-basic/src/main/java/org/apache/wayang/basic/operators/AzureBlobStorageSource.java
create mode 100644
wayang-commons/wayang-basic/src/main/java/org/apache/wayang/basic/operators/GoogleCloudStorageSource.java
copy
wayang-platforms/wayang-java/src/main/java/org/apache/wayang/java/mapping/{TextFileSourceMapping.java
=> AmazonS3SourceMapping.java} (74%)
copy
wayang-platforms/wayang-java/src/main/java/org/apache/wayang/java/mapping/{RepeatMapping.java
=> AzureBlobStorageSourceMapping.java} (72%)
copy
wayang-platforms/wayang-java/src/main/java/org/apache/wayang/java/mapping/{GlobalReduceMapping.java
=> GoogleCloudStorageSourceMapping.java} (72%)
copy
wayang-platforms/wayang-java/src/main/java/org/apache/wayang/java/operators/{JavaKafkaTopicSource.java
=> JavaAmazonS3Source.java} (52%)
copy
wayang-platforms/wayang-java/src/main/java/org/apache/wayang/java/operators/{JavaKafkaTopicSource.java
=> JavaAzureBlobStorageSource.java} (52%)
copy
wayang-platforms/wayang-java/src/main/java/org/apache/wayang/java/operators/{JavaKafkaTopicSource.java
=> JavaGoogleCloudStorageSource.java} (53%)
