Behind Yanrong SaaS service platform, which is as stable as a rock, is the rise of data ecology

Last month, , Yan Rong SaaS The data service platform was officially released , As a simple 、 Flexible and highly available NAS Shared data service platform , It can be said that the majority of small and medium-sized enterprises 、 Engineers use it to easily migrate 、 A powerful weapon for analyzing and securely sharing data .

In Yanrong SaaS After the platform goes online , Received more and more attention and praise , Many users began to wonder about Yanrong SaaS The story behind the platform 、 Business logic and underlying technology . To satisfy everyone's curiosity , This article will dig into Yan Rong SaaS The core technology behind the platform , Uncover Yanrong Yanrong SaaS How the platform provides users with high performance 、 High availability 、 Flexible services and products .

Yan Rong SaaS platform The birth of

At present , Distributed storage is mainly divided into three types ： Object storage 、 Block storage and file storage . among , Whether it's a system left over by history , Or for today's emerging technologies , Such as AI Training 、 Container and other scenarios , Distributed file storage is undoubtedly the most widely used 、 The best fit . Of course , File storage also faces a problem —— It is stored in the troika , One of the most complex storage types .

In a hybrid cloud strategy , File storage is an important part , Especially for scenarios with data interaction requirements , Is an indispensable part . With the further expansion of cloud native concept , User needs for storage , It also gradually extends from the original storage data to easy deployment 、 Ease of use , This is also a large number of Distributed Cloud File Storage Why .

Distributed cloud file storage radar map

meanwhile , As more and more users migrate their business to the public cloud , When the user selects storage for the application , Often in trouble .

First of all , Enterprises' pursuit of cost optimization , In almost all application scenarios, it is tireless , Even in the core application scenario , We still need to control costs . second , It's hard for us to quickly make data between private cloud and public cloud or between different clouds , Form a unified whole . Third , When facing different application scenarios, the same data , There will also be different demands for performance and functions , It's not enough just to rely on the storage type on the public cloud .

Advantages and challenges for file storage and business scenarios , Yanrong launched SaaS Data service platform —— Yan Rong SaaS platform , In fact, it will YRCloudFile In dealing with enterprise users , Accumulated mass storage technology advantages and practical experience , Apply to the public cloud environment , Combined with tiered storage strategy , Leverage cloud based access across virtual data centers , While meeting users' requirements for data access performance , Bring cost advantages to users , It also provides sufficient support for hybrid cloud solutions .

Yan Rong SaaS platform From the perspective of technical structure

From the perspective of technical architecture , Yan Rong SaaS The deployment mode of the platform follows the standard structure of the enterprise version , It adopts the virtual machine on the public cloud and cooperates with high-performance EBS disk , for example NVMe High performance disks , Provide corresponding external IOPS And bandwidth .

According to the needs of the business , Yan Rong SaaS The platform can be seamlessly and vertically extended in a transparent way to the business end , Through capacity expansion in a single cluster, more EC2 Virtual machine to increase the throughput of a single cluster . It can also be used in different public cloud availability areas , Create more storage clusters to host more services .

From the customer's application level , We can use NFS agreement （ Capacity type ） perhaps POSIX（ Performance type ） Access business data , Achieved on-demand use 、 Expand on demand , There is no need to build your own 、 Maintain the appropriate storage cluster . meanwhile , Utilize the quota of the storage cluster （Quota）,QoS Management ensures the security of data , Avoid contention .

While ensuring user access performance , Yan Rong SaaS The platform also makes full use of the object storage capacity on the cloud , According to the system defined policy , Will actively transfer cold data to S3 Object storage , But it does not destroy the user's ability to access the unified namespace .

Yan Rong SaaS Platform architecture

Yan Rong SaaS platform Optimize the layering strategy

at present , Yan Rong SaaS The storage of the platform is mainly divided into two levels ： Thermal data layer , Cold data layer . among , Clustered EC2 The storage pool composed of local disks is the hot data layer , It is a storage medium that frequently accesses data ; and S3 Objects are stored as cold data layers , It is a storage medium for infrequent access to data . From the application layer , All data is in the same namespace , The data scheduling is completed by the storage cluster itself .

In order to meet the capacity and performance requirements of users to the greatest extent , Yan Rong SaaS The platform creates file systems for each customer , By default Tiering Policy, You can put data into an object store . Because object storage accesses and transfers small files across the network, compared with large files , Low cost performance , Therefore, the system policy needs to consider both file access time and file data size , For example, for 512Byte The file of , Will not be transferred to S3 In storage , The default is reserved in the thermal data layer .

During continuous operation , Rely on Yanrong SaaS Multi platform MDS（ File system metadata service ） Ability , The data will be scanned , Data conforming to the policy will be placed in the object store . At a certain moment , Application access has been transferred to the data in the object store , Data transfer will occur automatically .

The idea of partial reading and writing

After the layering strategy is triggered , Part of the data will be placed in S3 Object store . here , If the business system accesses the corresponding data again , Yan Rong SaaS The platform will trigger data download . The usual default behavior is , The whole document passed S3 Download all the protocols , Then read the file with the file access protocol and return it to the user . In the process , Users can obviously feel the data access delay , Because you have to wait for all the data to download .

However, according to our measured data in various enterprise environments , Whether it's user behavior , Or the behavior of the program , In the process of data acquisition , There is optimization behavior . for example , Watch video files , The common behavior of users is drag viewing ; In some areas of analysis , The header of the file will also be read first , Read some subsequent parts according to the header information .

The idea to solve this problem is local reading and writing , Read and write file information according to the client program , Using documents MDS Information also corresponds to S3 Read and write the corresponding fragment on the object store and return it to the customer , At the same time, in order to make full use of the network bandwidth , Yan Rong SaaS The platform will align the read data range .

Partial read flow chart

Yan Rong SaaS platform Enterprise practice

Devops Stage

In Enterprises IT In the process of scheme transformation ,DevOps And the cloud are key drivers . according to Gartner forecast , To 2021 year , Global end users will spend more on public cloud services 18.4％, achieve 3049 Billion dollars , higher than 2020 Year of 2575 Billion dollars . stay COVID-19 After the crisis , Move to the cloud IT The proportion of expenditure will accelerate , Expect to 2024 year , The cloud will take over the global enterprise IT Total expenditure market 14.2％, higher than 2020 Year of 9.1％.

therefore , In Enterprises IT In the process of cloud solution , Whether from reliability 、 Sharing capability , From the point of view of operation convenience and maintenance cost , Storage is a crucial link . Through cloud storage , Enterprises can realize from CapEx Turn into OpEx Model , No need to buy a lot of physical storage hardware , Just use as needed , It can avoid a lot of equipment investment .

at present , Yan Rong SaaS The platform provides NFS as well as POSIX Access protocol for , It can be widely applied to enterprises IT Various services in . In the previous articles , We use “ Yan Rong SaaS The platform matches different applications ” The way , It fully demonstrates Yanrong SaaS The platform is highly available 、 Flexible features , Let's review ！

1、 Yan Rong SaaS Tips for getting started quickly on the platform

stay 《 A look at will understand ｜ Yan Rong SaaS Data service platform getting started guide 》 in , We clearly described how to create Yanrong SaaS Platform file system , Teach you to play Yanrong easily SaaS platform .

2、 Yan Rong SaaS platform + WordPress

WordPress As the most popular open source blog and content management website in the world , Many people will choose it to build a blog 、 Official website of the enterprise 、 Online retailers 、 Forums and other websites . stay 《 Starting from scratch , Based on Yanrong SaaS Build a private data service platform WordPress blog》 in , We will detail how to build a private network from the perspective of specific applications WordPress blog, Let you quickly have a “ Private domain ”.

3、 Yan Rong SaaS platform + Cloudreve

Now many people share and store resources through online disks , But limited resources have limited our play . stay 《 The network disk data needs to be moved ？ Yan Rong SaaS The data service platform teaches you to do this 》 in , We use Cloudreve For example , Teach you how to use Yanrong SaaS Storage provided by the platform , Simply and quickly build a personal network disk , The implementation ensures the reliability of data while , It's very convenient to share data .

4、 Yan Rong SaaS platform +Kubernetes

Yan Rong SaaS The platform is used for backup 、 Network disk 、 Other than file sharing , It can also be combined with Kubernetes, Create mounts on demand to further meet personalized needs , Let's study together ！《Kubernetes + Yan Rong SaaS Data service platform , Personalized demand support has not lost ！》

5、 Yan Rong SaaS platform +ELK

With the rapid growth of business , Generated by the system every day log It's going to grow , This contains a lot of valuable information . stay 《 One move teaches you to pass Yanrong SaaS Data service platform +ELK Let the log help you make decisions 》 in , We shared how to base on Yanrong SaaS The storage capacity provided by the platform , adopt ELK Build the overall software structure of the real-time log sharing platform .

And Yan Rong SaaS platform Together , Build a data ecology

at present , More and more users are turning to enterprise applications , Migrate and deploy to the public cloud , And use file based shared storage . Yanrong technology is an important leader and innovator in the field of file storage , It not only has a mature platform and excellent technical foundation , It also has strong forward-looking insight into market demand , The layout has developed an industry-leading data service platform , Hope that through Yanrong SaaS The platform brings users the ultimate experience in performance and use .

Yan Rong SaaS The platform is a fast iterative product , Technology symbiosis and capability integration with more partners are needed , To build a more stable 、 Prosperous data Ecology . From time to time , Create the future of data , We expect more partners to join Yanrong SaaS platform , I believe the future lies in Yanrong SaaS The most cutting edge will be born on the platform 、 The coolest ideas and Applications .