本文主要是介绍Spark中Master、Worker、Client通信示意图,希望对大家解决编程问题提供一定的参考价值,需要的开发者们随着小编来一起学习吧!
1.Master和Worker之间的消息传递示意图
2.Master和Client之间的消息传递示意图
这几天主要都是基于Standalone分析的,最后以两张图完美收工
原文地址:http://www.cnblogs.com/yourarebest/p/5313056.html
-
client to master
RegisterApplication
(向master注册application)
-
master to client
RegisteredApplication
(作为注册application的reply,回复给client)ExecutorAdded
(通知client worker已经启动了Executor环境,当向worker发送LaunchExecutor
后通知client)ExecutorUpdated
(通知client Executor状态已经发生变化了,包括结束、异常退出等,当worker向master发送ExecutorStateChanged
后通知client)
-
master to worker
LaunchExecutor
(发送消息启动Executor环境)RegisteredWorker
(作为worker向master注册的reply)RegisterWorkerFailed
(作为worker向master注册失败的reply)KillExecutor
(发送给worker请求停止executor环境)
-
worker to master
RegisterWorker
(向master注册自己)Heartbeat
(定期向master发送心跳信息)ExecutorStateChanged
(向master发送Executor状态改变信息)
这篇关于Spark中Master、Worker、Client通信示意图的文章就介绍到这儿,希望我们推荐的文章对编程师们有所帮助!