当前位置:网站首页>Motianlun domestic database salon | Xu Li: Alibaba cloud's native lindorm TSDB database drives the upgrading of industrial it & ot hyper integrated digital system

Motianlun domestic database salon | Xu Li: Alibaba cloud's native lindorm TSDB database drives the upgrading of industrial it & ot hyper integrated digital system

2022-06-12 00:00:00 Ink Sky Wheel

Sharing guests : Xu Li Alibaba cloud Lindorm Database product manager
Arrangement : Mo Tianlun

Reading guide

Hello everyone , I am a Alibaba cloud Lindom database Xu Li, product manager , It's my great honor to introduce Alibaba cloud to you today Lindom Database is a best practice case for industrial scenes , And the characteristics of the product , It should also be viewed in combination with the industry background and customer needs , Therefore, my sharing today consists of three themes : market trends 、 For those routes 、 Core competencies .

market trends

Industrial Internet of things 、 The rapid development of the Internet of vehicles industry , It produces a lot of data . Evaluation report display ,2025 The annual real-time data will account for... Of the total data 30%, Almost all real-time data will be generated by the Internet of things system , At the same time, the number of terminal equipment codes surged , Terminal intelligent device 、 Sensor data will flow into the cloud . therefore , To 2025 The vast majority of new cloud data in will come from the Internet of things 、 Intelligent interconnection scenarios such as Internet of vehicles .

Look at the domestic and global markets , The industrial Internet of things has great potential . The state strongly supports the development of China's industrial Internet of things at the policy level ,2019 、2020 It was introduced one after another in 《“5G+ Industrial Internet of things ”512 Project promotion plan 》 and 《 Notice on accelerating the development of industrial Internet of things 》, The strategic goal of China's development from a big industrial country to an industrial power has been made clear , We will accelerate “ Internet + manufacturing ”、“5G+ Industrial Internet of things ” The integration of innovation .


chart 1 Domestic market capacity of industrial Internet of things

So in this market trend , The birth and development of time series data should follow the trend .

For those routes

1、 Problems and challenges of digital intelligence upgrading in industrial scenes

New technology creates new opportunities to promote industrial upgrading at the same time , It also brings new technical challenges . More complex system architecture and higher performance 、 Stability requirements restrict the implementation of industrial Internet of things system , Enterprises need professional technology companies to help solve data collection problems 、 transmission 、 Storage 、 Analyze and visualize the difficulties in the construction of the whole chain data processing system .


chart 2 Construction difficulties and specific problems in digital intelligence upgrading

2、 Alibaba cloud Lindorm TSDB framework

Alibaba cloud Lindorm TSDB As a temporal database , It has four key values :

  • Asymmetric reading and writing and fast processing of massive time series data
  • Data storage efficiency is very high , The storage cost per unit of data volume has obvious advantages .
  • Build a unique data storage architecture for time series data , It has better performance in reading and processing timing data than other databases 、 Cost advantage .
  • Edge cloud Integration , The scheme integration is convenient and simple .

3、 Alibaba cloud Lindorm Design vision

Alibaba cloud Lindorm Our design vision is embodied in High throughput High performance Easy to use Easy maintenance Four aspects .

Cloud native multi-mode database Lindorm It's for the Internet 、 The Internet of things 、 Car networking 、 Super fusion database designed and optimized by industrial Internet , Support wide table 、 sequential 、 Text 、 object 、 flow 、 Unified access and fusion processing of space and other data , It is compatible with a variety of open source standard interfaces and seamless integration of tripartite ecological tools , It's a journal 、 monitor 、 bill 、 advertisement 、 social contact 、 Travel 、 Database is preferred for risk control and other scenarios , It is also one of the databases supporting Alibaba's core business , And it did “ Let massive data be visible 、 I can afford it “.


chart 3 Lindorm TSDB Driven industrial data cloud system architecture

Alibaba cloud native data Lindorm It is also applied to industrial data cloud scenarios .Lindorm oriented BEV New energy electric vehicle monitoring scene , Provide massive data storage with extreme cost performance 、 Open, ecologically compatible 、 Multi engine heterogeneous data fusion capabilities , With Jiangling, Great Wall Motors and other car factories 、 Neusoft and other Internet of vehicles service providers jointly build joint solutions to support the digital upgrading of Internet of vehicles system in the future .


chart 4 Lindorm Database evaluation certificate

Core competencies

1、 Core competence one : Software and hardware define multi-level storage

First , In different scenarios , Users can choose the storage mode by weighing the performance and the cost of storage , For example, performance storage 、 Standard storage 、 Capacity storage . Not only provides storage flexibility , At the same time, it can also be used in the scene of massive data , Save more storage investment .

2、 Core competence two : Automatic hot and cold separation

It is very difficult to use relational database to realize the separation, storage, database and table of cold and hot data , So from the industrial scene , More importantly, an easy to maintain and easy to use automatic management of hot and cold data .

Lindom The database automatically divides the data into hot and cold layers , Flexibly adjust the split line , And apply zero transformation 、 Fully transparent access , The cost of cold data storage is greatly reduced , The performance of hot data access is effectively improved .

3、 Core competence three : Intelligent feature compression

Intelligent feature compression is also Lindom TSDB One of the core capabilities of database products . Compared with the common in the industry SNAPPY, Increased compression 50%+, The compression ratio is as high as 10:1.


chart 5 Lindorm TSDB The core capability of intelligent feature compression

4、 Core competence 4 : High performance throughput

A business HBase Migrate to Lindom after , write in RT Reduced to 1/3


chart 6 Lindorm TSDB The core capability of high-performance throughput

5、 Core competence 5 : Integration of flow and library

Tradition ETL(Extract-Transform-Load, That is, the data is extracted from the source (extract)、 transformation (transform)、 load (load) To destination ) There is a high threshold for use , Pain points with large data delay , and Lindom Database stream library integration ,ELT On the go functionality .


chart 7 Lindorm TSDB The core capability of integrating flow and Library

6、 Core competence 6 : Sequential flow calculation

Timing flow computing is the sixth core capability of products . Abundant time series multidimensional aggregation operators in products , To support anomaly detection in the upper layer 、 Trend prediction algorithm , So as to carry out complex time series data processing .


chart 8 Lindorm TSDB The core capability of sequential flow computing

7、 Core competence 7 : timing engine TSQL

At the same time, on the query statement , compatible SQL grammar , Facilitate data docking and transformation .


chart 9 Lindorm TSDB timing engine TSQL The core competencies of

8、 Core competence 8 : Timing insight

Last ,Lindom The core competence of database is also reflected in time sequence insight . Except for anomaly detection , In addition to the commonly used algorithms of time series analysis , And the dimensionality reduction algorithm of sequence data , Help users find similarities from high-dimensional data 、 Correlation and causality .


chart 10 Lindom TSDB Core competence in timing insight

That's what I'm sharing today , Thank you. !

More highlights , Welcome to watch the video playback and conference materials
Video playback : https://www.modb.pro/video/6118
Conference materials : https://www.modb.pro/doc/56839

Mo Tianlun , Provide one-stop comprehensive service around the learning and growth of data people , Create a news collection 、 Online Q & A 、 Live broadcast of the event 、 Online courses 、 Document reading 、 Download resources 、 A unified platform for knowledge sharing and online operation and maintenance , Continue to promote knowledge dissemination and technological innovation in the field of data .

Official account : Mo Tianlun 、 Motianlun platform 、 Motianlun Growth Camp 、 Database localization 、 Database information

原网站

版权声明
本文为[Ink Sky Wheel]所创,转载请带上原文链接,感谢
https://yzsam.com/2022/03/202203011544414897.html