SaketaChalamchala commented on code in PR #206: URL: https://github.com/apache/ozone-site/pull/206#discussion_r2748052502
########## docs/04-user-guide/03-integrations/09-flink.md: ########## @@ -0,0 +1,196 @@ +--- +sidebar_label: Flink +--- + +# Apache Flink + +[Apache Flink](https://flink.apache.org/) is a powerful, open-source distributed processing framework designed for stateful computations over both bounded and unbounded data streams at any scale. It enables high-throughput, low-latency, and fault-tolerant processing while offering elastic scaling capabilities to handle millions of events per second across thousands of cores. + +Apache Flink can use Apache Ozone for reading and writing data, and for storing essential operational components like application state checkpoints and savepoints. + +## Quickstart + +This tutorial shows how to get started with connecting Apache Flink to Apache Ozone using the S3 Gateway, with Docker Compose. + +First, obtain Ozone's sample Docker Compose configuration and save it as `docker-compose.yaml`: + +```bash +curl -O https://raw.githubusercontent.com/apache/ozone-docker/refs/heads/latest/docker-compose.yaml +``` + +Refer to the [Docker quick start page](../../02-quick-start/01-installation/01-docker.md) for details. + +## Assumptions + +- Flink accesses Ozone through S3 Gateway instead of ofs. +- Ozone S3G listens on port 9878 +- Ozone S3G enables path style access. +- Ozone S3G does not enable security, therefore any S3 access key and secret key is accepted. +- Flink Docker image tag `flink:scala_2.12-java17` + +## Step 1 — Create `docker-compose-flink.yml` for Flink Review Comment: ```suggestion ### Step 2 — Create `docker-compose-flink.yml` for Flink ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
