IEICE Transactions on Information and Systems
Online ISSN : 1745-1361
Print ISSN : 0916-8532
Regular Section
2PTS: A Two-Phase Task Scheduling Algorithm for MapReduce
Byungnam LIMYeeun SHIMYon Dohn CHUNG
Author information
JOURNAL FREE ACCESS

2016 Volume E99.D Issue 9 Pages 2377-2380

Details
Abstract

For an efficient processing of large data in a distributed system, Hadoop MapReduce performs task scheduling such that tasks are distributed with consideration of the data locality. The data locality, however, is limitedly exploited, since it is pursued one node at a time basis without considering the global optimality. In this paper, we propose a novel task scheduling algorithm that globally considers the data locality. Through experiments, we show our algorithm improves the performance of MapReduce in various situations.

Content from these authors
© 2016 The Institute of Electronics, Information and Communication Engineers
Previous article Next article
feedback
Top