This is an automated email from the ASF dual-hosted git repository.
zkaoudi pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git
The following commit(s) were added to refs/heads/main by this push:
new 73839d9 Update README.md
73839d9 is described below
commit 73839d9a9d672a085ba993844054a3cc0380b6a2
Author: Zoi Kaoudi <[email protected]>
AuthorDate: Wed Oct 20 00:06:00 2021 +0200
Update README.md
Fixed some typos
---
README.md | 13 ++++++-------
1 file changed, 6 insertions(+), 7 deletions(-)
diff --git a/README.md b/README.md
index ff9c25b..391d0d3 100644
--- a/README.md
+++ b/README.md
@@ -7,12 +7,11 @@
-#### Turning a shadows into a show
+#### The first cross-platform data processing system
+In contrast to traditional data processing systems that provide one dedicated
execution engine, Apache Wayang is a *cross-platform data processing system*:
Users can specify any data processing application using one of Wayang's API and
then Wayang will choose the data processing platform(s), e.g., Postgres or
Apache Spark, that best fits the application. Finally, Wayang will perform the
execution, thereby hiding the different platform-specific APIs and coordinating
inter-platform communication.
-Apache Wayang in contrast to classical data processing systems that provide
one dedicated execution engine, Apache Wayang rather is a *meta processing
framework*: You can specify your data processing app via one of Wayang's API
and then Wayang will pick an optimal configuration of classical processing
frameworks, such as Java Streams or Apache Spark, to run your app on. Finally,
Wayang will also perform the execution, thereby hiding the different specific
platform APIs and coordinate int [...]
-
-This approach aims at freeing data engineers and software developers from the
burden of knowing the zoo of different data processing systems, their APIs,
strengths and weakness; the intricacies of coordinating and integrating
different processing platforms; and the inflexibility when tying to a fix set
of processing platforms. As of now, Wayang has built in support for the
following processing platforms:
+Apache Wayang aims at freeing data engineers and software developers from the
burden of learning all different data processing systems, their APIs, strengths
and weaknesses; the intricacies of coordinating and integrating different
processing platforms; and the inflexibility when trying a fixed set of
processing platforms. As of now, Wayang has built-in support for the following
processing platforms:
- [Java
Streams](https://docs.oracle.com/javase/8/docs/api/java/util/stream/Stream.html)
- [Apache Spark](https://spark.apache.org/)
- [GraphChi](https://github.com/GraphChi/graphchi-java)
@@ -22,11 +21,11 @@ This approach aims at freeing data engineers and software
developers from the bu
## How to use Wayang
**Requirements.**
-Apache Wayang is built with Java 8 and Scala 2.11. However, to execute Wayang
it is sufficient to have Java 8 installed. If you want to build Wayang
yourself, you will also need to have [Apache Maven](http://maven.apache.org)
installed and Apache Hadoop (The version that you want). Please also consider
that processing platforms employed by Wayang might have further requirements.
+Apache Wayang is built with Java 8 and Scala 2.11. However, to execute Wayang
it is sufficient to have Java 8 installed. If you want to build Wayang
yourself, you will also need to have [Apache Maven](http://maven.apache.org)
installed and Apache Hadoop (the version that you want). Please also consider
that processing platforms employed by Wayang might have further requirements.
-> **NOTE:** In windows, you need to define the variable `HADOOP_HOME` with the
winutils.exe, an not official option to obtain [this
repository](https://github.com/steveloughran/winutils), or you can generate
your winutils.exe following the instruction in the repository. Also, you may
need to install
[msvcr100.dll](https://www.microsoft.com/en-us/download/details.aspx?id=26999)
+> **NOTE:** In windows, you need to define the variable `HADOOP_HOME` with the
winutils.exe, an not official option to obtain [this
repository](https://github.com/steveloughran/winutils), or you can generate
your winutils.exe following the instructions in the repository. Also, you may
need to install
[msvcr100.dll](https://www.microsoft.com/en-us/download/details.aspx?id=26999)
-> **NOTE:** Currently Apache Wayang is updating Java and Scala, consider that
for you be enable to utilize Scala 2.12 you will need to install Java 11 in
your enviroment
+> **NOTE:** Currently Apache Wayang is updating Java and Scala, consider that
to be able to utilize Scala 2.12 you will need to install Java 11 in your
enviroment
**Get Wayang.**
Wayang is available via Maven Central. To use it with Maven, for instance,
include the following into you POM file:
