At the bottom is Linux+PC Server, The upper software is Feitian , Flying sky is Alibaba cloud 09 A distributed system software was developed in , It mainly provides distributed storage and scheduling of distributed computing 、 Programming framework . The development language is C++, 2013 The system supports scheduling in the production environment 5000 Clusters of machines .
Feitian more interesting is the name of the module , They all choose from traditional Chinese myths , For example, the distributed storage module is called Pangu , The dispatcher's name is Fuxi .
Standing on the hadoop From the perspective of , The functions and hadoop It's similar , stay yarn Before ,hadoop The main programming model is MapReduce, Feitian's programming model is a directed acyclic graph , In addition to supporting batch tasks, it also supports resident Service. The details of the implementation are, of course, completely different , First of all, the programming language Feitian chose C++. Other things like security 、 Operation and maintenance systems are very different .
ODPS It's a set of services provided on top of Feitian , Features include SQL, be based on java Of Mapreduce Programming framework , Graph computing programming model , Implementation of a series of machine learning algorithms and so on . All the functions are based on RESTful API In the form of , So from the system boundary , This floor API Isolated ODPS Platform and user system , and hadoop The difference is also obvious .ODPS It was designed to be open to the outside world , To be a multi tenant public data processing service based on the Internet , So security is ODPS Has the highest priority in the design and implementation of .
There is not enough knowledge to answer the impact of future transportation industry , I think we can consider the impact of large-scale data processing capacity on the transportation industry . On the plus ODPS It is convenient for large-scale data processing ability to obtain this angle .
Interest related ： Ali employees , front ODPS Team members
