当前位置:网站首页>Flink的安装和测试
Flink的安装和测试
2020-11-09 15:25:00 【程序猿欧文】
一. Flink的下载
安装包下载地址 ,选择对应Hadoop的Flink版本下载
Flink 有三种部署模式,分别是 Local、Standalone Cluster 和 Yarn Cluster。
二. Local模式
对于 Local 模式来说,JobManager 和 TaskManager 会公用一个 JVM 来完成 Workload。如果要验证一个简单的应用,Local 模式是最方便的。实际应用中大多使用 Standalone 或者 Yarn Cluster,而local模式只是将安装包解压启动(./bin/start-local.sh)即可,在这里不在演示。
三. Standalone 模式
1. 集群部署规划
节点名称 | master | worker | zookeeper |
hadoop01 | master | zookeeper | |
hadoop02 | master | worker | zookeeper |
hadoop03 | woker | zookeeper |
2. 解压
[hadoop@hadoop01 apps]$ tar -zxvf flink-1.7.2-bin-scala_2.11.tgz -C ./
[hadoop@hadoop01 apps]$ ls
azkaban flink-1.7.2 flink-1.7.2-bin-scala_2.11.tgz flume-1.8.0 hadoop-2.7.4 jq kafka_2.11-0.11 zkdata zookeeper-3.4.10 zookeeper.out
3. 修改配置文件
[hadoop@hadoop01 apps]$ cd flink-1.7.2/
[hadoop@hadoop01 flink-1.7.2]$ ls
bin conf examples lib LICENSE licenses log NOTICE opt README.txt
[hadoop@hadoop01 flink-1.7.2]$ cd conf/
[hadoop@hadoop01 conf]$ ls
flink-conf.yaml log4j-console.properties log4j-yarn-session.properties logback.log4j-cli.properties log4j.properties logback-console.
修改fli.........
版权声明
本文为[程序猿欧文]所创,转载请带上原文链接,感谢
https://my.oschina.net/mikeowen/blog/4710055
边栏推荐
- The technology masters who ride the wind and waves gather again | Tencent cloud TVP continues to sail
- Do programmers pay too much to work overtime? Should programmer's salary be reduced? Netizen: let go of other hard pressed programmers
- 要我说,多线程事务它必须就是个伪命题!
- MES系统在行业应用里区别于传统式管理
- Native地图与Web融合技术的应用与实践
- 瞧瞧,这样的『函数』才叫 Pythonic
- 缓存的数据一致性
- 岗位内推 | 微软亚洲研究院智能多媒体组招聘计算机视觉算法实习生
- Why is your money transferred? This article tells you the answer
- MES system is different from traditional management in industry application
猜你喜欢
Some common types of error exception in Python
I interviewed a 33 year old Android programmer, who could only program for Baidu, but wanted 25K, which was met by me
缓存的数据一致性
Decrypting the future database design: implementation of mongodb's new storage engine wiredtiger (transaction)
Using GaN based oversampling technique to improve the accuracy of model for mortality prediction of unbalanced covid-19
How to use Camtasia to make dynamic animation scene?
The technology masters who ride the wind and waves gather again | Tencent cloud TVP continues to sail
程序员买房前后对比,看完后已哭瞎...
使用基于GAN的过采样技术提高非平衡COVID-19死亡率预测的模型准确性
移动安全加固助力 App 实现全面、有效的安全防护
随机推荐
Some common types of error exception in Python
Booker · apachecn programming / back end / big data / AI learning resources 2020.11
SEO builders, what are the unspeakable hardships?
C language (circular list) to achieve the basic function of snake
The worst hacker in history: stealing $1 billion of bitcoin without spending it for seven years, and finally being seized by the Department of justice
Performance comparison of serialization tools such as Jackson, fastjson, kryo, protostuff
听说你一夜之间变了户籍,依萍如洗的打工人该如何自救?
Offline installation method of Arthas without network environment
Why is your money transferred? This article tells you the answer
The way of a million year salary Architect: on the architecture design of application system
Android字节跳动一面,被面试官吊打!幸得美团内推,三面拿到offer
Using GaN based oversampling technique to improve the accuracy of model for mortality prediction of unbalanced covid-19
毕业一年后接私活赚了10w,还拿了几家大厂offer!
腾讯云服务器搭建wordpress网站的两种方式(详细图文新手版)
MES系统在行业应用里区别于传统式管理
Spark Learning (2) -- job scheduling and shuffle analysis
The technology masters who ride the wind and waves gather again | Tencent cloud TVP continues to sail
百万年薪架构师之路:谈应用系统架构设计
CAD2016软件安装教程
js字符与ASCII码互转的方法