Locality

A delay scheduling algorithm in short operating environment Daiju Zhu Zhengdong WY PK. The delay scheduling algorithm based on the static time waiting threshold for the yarn platform in the short job scene is not reasonable waiting, and a delayed scheduling algorithm based on local resource prediction in cloud computing environment is proposed (locality Resource forecast delay scheduling, LRFD). This algorithm takes into account the characteristics of short operation and dynamic change of resource availability to carry out task scheduling, according to the completion schedule of tasks on the node and ...

MapReduce the improvement and realization of job scheduling algorithm in Hadoop platform Jie Huijuan College of Applied Science and Technology of Hainan University This paper analyzes the existing three job scheduling algorithms based on the MapReduce architecture implemented by Hadoop, In view of the disadvantage that the current algorithm does not consider the server load status and the poor data locality, a fair scheduling algorithm (FSVQ) based on variable length queue is proposed, which analyzes the idle node rate and satisfies the consideration of data locality by taking the waiting method. Experimental results show that the algorithm can increase the server cluster ...