[ https://issues.apache.org/jira/browse/FLINK-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15359034#comment-15359034 ]
ASF GitHub Bot commented on FLINK-4118: --------------------------------------- Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/2176#discussion_r69307034 --- Diff: flink-contrib/docker-flink/README.md --- @@ -1,80 +1,75 @@ -#Apache Flink cluster deployment on Docker using Docker-Compose +Apache Flink cluster deployment on docker using docker-compose -##Installation -###Install Docker +# Installation +Install the most recent stable version of docker https://docs.docker.com/installation/ -if you have issues with Docker-Compose versions incompatible with your version of Docker try +Install the most recent stable version of docker-compose +https://docs.docker.com/compose/install/ -`curl -sSL https://get.docker.com/ubuntu/ | sudo sh` +# Build -###Install Docker-Compose +Images are based on the official Java Alpine (OpenJDK 8) image and run +supervisord to stay alive when running containers. If you want to build the +flink image run: -``` -curl -L https://github.com/docker/compose/releases/download/1.1.0/docker-compose-`uname -s`-`uname -m` > /usr/local/bin/docker-compose + sh build.sh -chmod +x /usr/local/bin/docker-compose -``` - -###Get the repo - -###Build the images +or -Images are based on Ubuntu Trusty 14.04 and run Supervisord to stay alive when running containers. + docker build -t flink . -The base image installs Oracle Java JDK 1.7 and SSH client & server. You can change the SSH password there or add your own key and adjust SSH config. +If you want to build the container for a specific version of flink/hadoop/scala +you can configure it in the respective args: -- Run `./build.sh` + docker build --build-arg FLINK_VERSION=1.0.3 --build-arg HADOOP_VERSION=26 --build-arg SCALA_VERSION=2.10 -t "flink:1.0.3-hadoop2.6-scala_2.10" flink -###Deploy +# Deploy - Deploy cluster and see config/setup log output (best run in a screen session) -`docker-compose up` + docker-compose up - Deploy as a daemon (and return) -`docker-compose up -d` + docker-compose up -d - Scale the cluster up or down to *N* TaskManagers -`docker-compose scale taskmanager=<N>` - -- Access the JobManager node with SSH (exposed on Port 220) + docker-compose scale taskmanager=<N> -`ssh root@localhost -p 220` +- Access the Job Manager container -or on Mac OS X with boot2docker - -`ssh root@$(boot2docker ip) -p 220` - -The password is 'secret' + docker exec -it $(docker ps --filter name=flink_jobmanager --format={{.ID}}) /bin/sh - Kill the cluster -`docker-compose kill` + docker-compose kill - Upload a jar to the cluster -`scp -P 220 <your_jar> root@localhost:/<your_path>` + for i in $(docker ps --filter name=flink --format={{.ID}}); do --- End diff -- Yep, the TaskManagers pull it from the JobManager which keeps it in a component called BlobManager. > The docker-flink image is outdated (1.0.2) and can be slimmed down > ------------------------------------------------------------------ > > Key: FLINK-4118 > URL: https://issues.apache.org/jira/browse/FLINK-4118 > Project: Flink > Issue Type: Improvement > Reporter: Ismaël Mejía > Priority: Minor > > This issue is to upgrade the docker image and polish some details in it (e.g. > it can be slimmed down if we remove some unneeded dependencies, and the code > can be polished). -- This message was sent by Atlassian JIRA (v6.3.4#6332)