Some ideas about Apache mesos

I focus on ApacheMesos It's been a long time .ApacheMesos Start with the research paper ,2010 Become a year Apache Incubation projects , Later from ASF“ graduation ”, And in 2013 Establish a business entity Mesosphere.

The past few months , A lot of things happened , So I thought , This is a good opportunity to write about Mesos And its ecological article .

About Mesos and YARN There has been a lot of discussion . I have also seen things like “Mesos Our resource request model is very backward ” The comments , Also noted Mesos It has become more popular in the past few years . One of the key factors here may be Docker Hype and their respective needs for the collaboration layer . At the end of this article , We will return to Mesos vs. YARN The topic of .

I admit that I didn't fully understand it before Mesos The real potential of , Until that day, I sat reading Mesos A research paper , It includes design philosophy 、 Resource allocation 、 Isolation assurance and fault tolerance .

Mesos The core challenge is , How to meet the requirements of a framework without knowing a framework constraint （constraints）, This is also the most difficult part of resource allocation .Mesos The way to deal with resources is like a parent hosting a child's birthday party ： For example, you have to work for 15 A child （== frame ） Provide food （== resources ）, And it's impossible to know their preferences （== Resettlement tendency ）. But you can offer them a pizza or a bowl of sesame , And they can accept it for free （ Now? Or after a while ） Or refuse . and , Dad who just picked up a guest to get off the bus may tell you , The man's child is a vegetarian , Then provide beef hamburgers （== Filter ） It doesn't make sense to give it to that child .

There is an interesting fact （ Although I think this is well known ）,Mesos and Spark Have one thing in common ：Matei Zaharia—— From a small town near Ontario, Canada —— He is Berkeley, California AMP Lab students , This laboratory is Mesos and Spark Have made great contributions . lately , He served as Databricks Of CTO,Databricks Is a guide Spark Business entity company .

go back to Mesos vs. YARN—— Fortunately, recently, this is no longer an alternative problem ： Use Myriad project （ from eBay、Mesosphere and MapR Joint development of , Now it's up to ASF incubation ）, You can let them in colony Coexist and schedule them . In short , It's a Mesos The frame is used to Dynamic expansion YARN colony , And support operation Hadoop application , Such as Spark He Fei Hadoop application , Such as Node.js、Memcached、RoR etc. . An exciting moment ！

This is my personal view of Apache Mesos View of the , Written in 2015 In the middle of February . I will continue to pay attention to Myriad, As a beginner, if you haven't tried , Maybe you can try test driven Mesos.