当前位置:网站首页>Flink: from introduction to Zhenxiang (3. Reading data from collection and file)
Flink: from introduction to Zhenxiang (3. Reading data from collection and file)
2020-11-08 12:06:00 【open_neocf7df】
You can refer to : https://blog.51cto.com/mapengfei/2546985
Reading data from a collection
New package ,com.mafei.apitest, Create a new one scala Object class ,
package com.mafei.apitest
import org.apache.flink.api.scala.createTypeInformation
import org.apache.flink.streaming.api.scala.StreamExecutionEnvironment
// Get sensor data
case class SensorReading(id: String,timestamp: Long, temperature: Double)
object SourceTest {
def main(args: Array[String]): Unit = {
// Create an execution environment
val env = StreamExecutionEnvironment.getExecutionEnvironment
// 1、 Reading data from a collection
val dataList = List(
SensorReading("sensor1",1603766281,41),
SensorReading("sensor2",1603766282,42),
SensorReading("sensor3",1603766283,43),
SensorReading("sensor4",1603766284,44)
)
val stream1 = env.fromCollection(dataList)
stream1.print()
// perform
env.execute(" source test")
}
}
Code catalog diagram :
Running effect
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2> SensorReading(sensor3,1603766283,43.0)
4> SensorReading(sensor1,1603766281,41.0)
3> SensorReading(sensor4,1603766284,44.0)
1> SensorReading(sensor2,1603766282,42.0)
Read data from file
Just like the first step , New package ,com.mafei.apitest, Create a new one scala Object class ,
package com.mafei.apitest
import org.apache.flink.api.scala.createTypeInformation
import org.apache.flink.streaming.api.scala.StreamExecutionEnvironment
// Get sensor data
case class SensorReading(id: String,timestamp: Long, temperature: Double)
object SourceTest {
def main(args: Array[String]): Unit = {
// Create an execution environment
val env = StreamExecutionEnvironment.getExecutionEnvironment
// Reading data from a file
val stream2= env.readTextFile("/opt/java2020_study/maven/flink1/src/main/resources/sensor.txt")
stream2.print()
// perform
env.execute(" source test")
}
}
stay resources New under the directory sensor.txt, Write the following
sensor1,1603766281,41
sensor2,1603766282,42
sensor3,1603766283,43
sensor4,1603766284,44
Code structure diagram :
Code running effect :
1> sensor1,1603766281,41
1> sensor2,1603766282,42
2> sensor3,1603766283,43
3> sensor4,1603766284,44
版权声明
本文为[open_neocf7df]所创,转载请带上原文链接,感谢
边栏推荐
- VC + + specified directory file output by time
- OR Talk NO.19 | Facebook田渊栋博士:基于蒙特卡洛树搜索的隐动作集黑盒优化 - 知乎
- Close to the double 11, he made up for two months and successfully took the offer from a large factory and transferred to Alibaba
- Introduction to mongodb foundation of distributed document storage database
- C语言I博客作业03
- Flink的sink实战之一:初探
- Understanding design patterns
- ArrayList源码分析
- Tight supply! Apple's iPhone 12 power chip capacity exposed
- 渤海银行百万级罚单不断:李伏安却称治理完善,增速呈下滑趋势
猜你喜欢
应届生年薪35w+ !倒挂老员工,互联网大厂薪资为何越来越高?
优化if-else代码的八种方案
Hematemesis! Alibaba Android Development Manual! (Internet disk link attached)
Service architecture and transformation optimization process of e-commerce trading platform in mogujie (including ppt)
Flink's sink: a preliminary study
Adobe media encoder / me 2021 software installation package (with installation tutorial)
Second assignment
阿里出品!视觉计算开发者系列手册(附网盘链接)
C language I blog assignment 03
Learning summary (about deep learning, vision and learning experience)
随机推荐
2018中国云厂商TOP5:阿里云、腾讯云、AWS、电信、联通 ...
值得一看!EMR弹性低成本离线大数据分析最佳实践(附网盘链接)
The container with the most water
漫画|讲解一下如何写简历&项目
Top 5 Chinese cloud manufacturers in 2018: Alibaba cloud, Tencent cloud, AWS, telecom, Unicom
笔试面试题目:盛水最多的容器
第二次作业
The progress bar written in Python is so wonderful~
Ubuntu20.04下访问FTP服务器乱码问题+上传文件
It's worth seeing! EMR elastic low cost offline big data analysis best practice (with network disk link)
Harbor项目高手问答及赠书活动
笔试面试题目:求缺失的最小正整数
阿里撕下电商标签
When kubernetes encounters confidential computing, see how Alibaba protects the data in the container! (Internet disk link attached)
笔试面试题目:判断单链表是否有环
BCCOIN告诉您:年底最靠谱的投资项目是什么!
运维人员常用到的 11 款服务器监控工具
Tight supply! Apple's iPhone 12 power chip capacity exposed
next.js实现服务端缓存
维图PDMS切图软件