Downloading Flink
You can download flink from it’s Apache’s site. We are downloading Flink 1.6, which is the latest version available.
https://flink.apache.org/downloads.html
It requires Java version 8.
java –version
Running Flink Cluster
Let’s start the cluster. We can just run it directly from bin folder using start-cluster.sh utility available with the download. Alternatively we can run it locally using start-local.sh.
./bin/start-cluster.sh
The dashboard is available on port 8081. We can launch it access it through a web browser.
http://localhost:8081/#/overview
We can check the processes it starts up when kicking up the cluster.
ps -ef | grep flink
It creates a few log files in the log folder:
ls -ltr
Task Managers
Apache Flink supports more than one task managers.
Task Manager
Job Manager
Apache Flink has one job manager.
Job Manager