skip to main content
research-article

Theoretical and heuristic aspects of heterogeneous system scheduling with constraints on clients multiple I/O ports

Published: 01 January 2018 Publication History

Abstract

An effective scheduling algorithm for distributed computing systems is essential for assigning clients tasks to run on a set of processors at a minimum makespan. Existing algorithms permit the client tasks to be sent and received simultaneously to the processors without any possibility of collisions. This implies an unrealistic situation that there is an unlimited number of I/O ports which in fact is physically limited by the underlying architecture and technology. This paper takes this crucial constraint of I/O ports that no existing algorithm has addressed as a part of client task scheduling. Task to be scheduled are represented by a directed acyclic graph with arbitrary dependency structures and arranged by their critical paths. Two theoretical scheduling patterns under multiple I/O ports to achieve the optimal makespan with minimum latent delay are discovered and proved, namely, triangular and parallelogram patterns. They are used as the principal basis for the proposed scheduling algorithm. The focus is on collision avoidance of these tasks to be sent or received through the multiple I/O ports. Plots of task graph on performance comparison with other algorithms from the experiment show that the proposed algorithm outperforms other algorithms in terms of shorter makespan, less delay, and less number of ports used. In the real application data set, the makespan performance obtained by the proposed algorithm is better than other algorithms by 62.05%. We concern the realistic effects of multiple client I/O ports on optimal scheduling that existing algorithms did not address.Theoretical optimal scheduling patterns were established and formally proved.An efficient scheduling algorithm based on scheduling patterns was proposed.Our results were better than those of other algorithms under multiple I/O ports constraint.

References

[1]
M. Gallet, L. Marchal, F. Vivien, Efficient scheduling of task graph collections on heterogeneous resources, in: IEEE International Symposium on Parallel Distributed Processing, 2009. IPDPS 2009. 2009, pp. 111.
[2]
K. Agrawal, A. Benoit, L. Magnan, Y. Robert, Scheduling algorithms for linear workflow optimization, in: 2010 IEEE International Symposium on Parallel Distributed Processing, IPDPS, 2010, pp. 112.
[3]
O. Beaumont, N. Bonichon, L. Eyraud-Dubois, Scheduling divisible workloads on heterogeneous platforms under bounded multi-port model, in: IEEE International Symposium on Parallel and Distributed Processing, 2008. IPDPS 2008. 2008, pp. 17.
[4]
O. Beaumont, L. Eyraud-Dubois, H. Rejeb, C. Thraves, Allocation of clients to multiple servers on large scale heterogeneous platforms, in: 2009 15th International Conference on Parallel and Distributed Systems, ICPADS, 2009, pp. 142149.
[5]
W.K. Huang, X. Chen, L. Bhuyan, F. Lombardi, Accurate communication models for task scheduling in multicomputers, in: Seventh IEEE Symposium on Parallel and Distributed Processing, 1995. Proceedings. 1995, pp. 524529.
[6]
O. Sinnen, L. Sousa, Task scheduling: considering the processor involvement in communication, in: Third International Workshop on Parallel and Distributed Computing, 2004. Third International Symposium on/Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks, 2004. 2004, pp. 328335.
[7]
O. Beaumont, V. Boudet, Y. Robert, A realistic model and an efficient heuristic for scheduling with heterogeneous processors, in: Parallel and Distributed Processing Symposium., Proceedings International, IPDPS 2002, 2002, pp. 14 pp.
[8]
O. Sinnen, L. Sousa, F.-E. Sandnes, Toward a realistic task scheduling model, IEEE Trans. Parallel Distrib. Syst., 17 (2006) 263-275.
[9]
O. Sinnen, A. To, M. Kaur, Contention-aware scheduling with task duplication, J. Parallel Distrib. Comput., 71 (2011) 77-86.
[10]
D.D. Sharma, Intel; 5520 chipset: An i / o hub chipset for server, workstation, and high end desktop, in: 2009 IEEE Hot Chips 21 Symposium, HCS, 2009, pp. 118.
[11]
Q.T. Inc., Qualcomm Snapdragon 410 Processor APQ8016 Device Specification, Qual. Technol. (2015) 106.
[12]
W.J.B. Han, Clustering wireless ad hoc networks with weakly connected dominating set, J. Parallel Distrib. Comput. (2007) 727-737.
[13]
D. Kempe, J. Kleinberg, A. Kumar, Connectivity and inference problems for temporal networks, J. Comput. System Sci., 64 (2002) 820-842.
[14]
F. Kuhn, R. Oshman, Dynamic networks: Models and algorithms, SIGACT News, 42 (2011) 82-96.
[15]
X. Cai, D. Sha, C. Wong, Non-Static network optimization problems: A survey, in: Optimization Methods and Applications, Vol. 52, Springer, US, 2001, pp. 219-246.
[16]
K. Shvachko, H. Kuang, S. Radia, R. Chansler, The hadoop distributed file system, in: 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies, MSST, 2010, pp. 110, ISSN: 2160-195X.
[17]
W. Chongdarakul, P. Sophatsathit, C. Lursinsap, Efficient task scheduling based on theoretical scheduling pattern constrainted on single i/o port collision avoidance, Simul. Modell. Pract. Theory J. (2016) 171-190.
[18]
V. Chang, G. Wills, A model to compare cloud and non-cloud storage of Big Data, Future Gener. Comput. Syst., 57 (2016) 56-76.
[19]
V. Chang, Y.-H. Kuo, M. Ramachandran, Cloud computing adoption framework: A security framework for business clouds, Future Gener. Comput. Syst., 57 (2016) 24-41.
[20]
F. Pinel, J. Pecero, P. Bouvry, S. Khan, A two-phase heuristic for the scheduling of independent tasks on computational grids, in: 2011 International Conference on High Performance Computing and Simulation, HPCS, 2011, pp. 471477.
[21]
H. Izakian, A. Abraham, V. Snasel, Comparison of heuristics for scheduling independent tasks on heterogeneous distributed environments, in: International Joint Conference on Computational Sciences and Optimization, 2009. CSO 2009. Vol. 1, 2009, pp. 812.
[22]
C. Zhao, S. Zhang, Q. Liu, J. Xie, J. Hu, Independent tasks scheduling based on genetic algorithm in cloud computing, in: 5th International Conference on Wireless Communications, Networking and Mobile Computing, 2009. WiCom 09. 2009, pp. 14.
[23]
B. Hamidzadeh, L.Y. Kit, D. Lilja, Dynamic task scheduling using online optimization, IEEE Trans. Parallel Distrib. Syst., 11 (2000) 1151-1163.
[24]
O. Arnold, G. Fettweis, On the impact of dynamic task scheduling in heterogeneous MPSoCs, in: 2011 International Conference on Embedded Computer Systems, SAMOS, 2011, pp. 1724.
[25]
A. Page, T. Naughton, Dynamic task scheduling using genetic algorithms for heterogeneous distributed computing, in: Parallel and Distributed Processing Symposium, 2005. Proceedings. 19th IEEE International, 2005, pp. 189.1189.8.
[26]
S.K. Nayak, S.K. Padhy, S.P. Panigrahi, A novel algorithm for dynamic task scheduling, Future Gener. Comput. Syst., 28 (2012) 709-717.
[27]
K. Hwang, McGraw-Hill Higher Education, 1992.
[28]
H. El-Rewini, T. Lewis, Scheduling parallel program tasks onto arbitrary target machines, J. Parallel Distrib. Comput., 9 (1990) 138-153.
[29]
M.A. Iverson, F. zgner, G.J. Follen, Parallelizing existing applications in a distributed heterogeneous environment, in: 4th Heterogeneous Computing Workshop, HCW 95, 1995, pp. 93100.
[30]
H. Topcuoglu, S. Hariri, M.-Y. Wu, Performance-effective and low-complexity task scheduling for heterogeneous computing, IEEE Trans. Parallel Distrib. Syst., 13 (2002) 260-274.
[31]
H. Oh, S. Ha, A static scheduling heuristic for heterogeneous processors, in: Lecture Notes in Computer Science, vol. 1124, Springer Berlin Heidelberg, 1996, pp. 573-577.
[32]
A. Radulescu, A.J.C. Van Gemund, Fast and effective task scheduling in heterogeneous systems, in: Heterogeneous Computing Workshop, 2000. HCW 2000, Proceedings. 9th, 2000, pp. 229238.
[33]
M.I. Daoud, N. Kharma, A high performance algorithm for static task scheduling in heterogeneous distributed computing systems, J. Parallel Distrib. Comput., 68 (2008) 399-409.
[34]
G. Sih, E. Lee, A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architectures, IEEE Trans. Parallel Distrib. Syst., 4 (1993) 175-187.
[35]
T. Hagras, J. Janecek, A simple scheduling heuristic for heterogeneous computing environments, in: Second International Symposium on Parallel and Distributed Computing, 2003. Proceedings. 2003, pp. 104110.
[36]
Y. Kang, Y. Lin, A recursive algorithm for scheduling of tasks in a heterogeneous distributed environment, in: 2011 4th International Conference on Biomedical Engineering and Informatics, BMEI, Vol. 4, 2011, pp. 20992103.
[37]
G.Q. Liu, K.L. Poh, M. Xie, Iterative list scheduling for heterogeneous computing, J. Parallel Distrib. Comput., 65 (2005) 654-665.
[38]
N.A. Bahnasawy, F. Omara, M.A. Koutb, M. Mosa, Optimization procedure for algorithms of task scheduling in high performance heterogeneous distributed computing systems, Egyptian Inform. J., 12 (2011) 219-229.
[39]
R. Eswari, S. Nickolas, Path-based heuristic task scheduling algorithm for heterogeneous distributed computing systems, in: 2010 International Conference on Advances in Recent Technologies in Communication and Computing, ARTCom, 2010, pp. 3034.
[40]
P. Mu, J.-F. Nezan, M. Raulet, A list scheduling heuristic with new node priorities and critical child technique for task scheduling with communication contention, in: Lecture Notes in Electrical Engineering, vol. 73, Springer Netherlands, 2011, pp. 217-236.
[41]
H. Arabnejad, J. Barbosa, List scheduling algorithm for heterogeneous systems by an optimistic cost table, IEEE Trans. Parallel Distrib. Syst., 25 (2014) 682-694.
[42]
E. Ilavarasan, P. Thambidurai, R. Mahilmannan, High performance task scheduling algorithm for heterogeneous computing system, in: Lecture Notes in Computer Science, vol. 3719, Springer Berlin Heidelberg, 2005, pp. 193-203.
[43]
E. Ilavarasan, P. Thambidurai, Low complexity performance effective task scheduling algorithm for heterogeneous computing environments, Comput. Sci., 3 (2007) 94-103.
[44]
T. Hagras, J. Janecek, A near lower-bound complexity algorithm for compile-time task-scheduling in heterogeneous computing systems, in: Third International Symposium on Parallel and Distributed Computing/Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks, 2004, pp. 106113.
[45]
S.C. Kim, S. Lee, Push-pull: guided search dag scheduling for heterogeneous clusters, in: International Conference on Parallel Processing, 2005. ICPP 2005. 2005, pp. 603610.
[46]
R. Lepere, D. Trystram, A new clustering algorithm for large communication delays, in: Proceedings of the 16th International Parallel and Distributed Processing Symposium, 2002, pp. 6873.
[47]
T. Yang, A. Gerasoulis, Dsc: scheduling parallel tasks on an unbounded number of processors, IEEE Trans. Parallel Distrib. Syst., 5 (1994) 951-967.
[48]
S. Kim, J. Browne, A general approach to mapping of parallel computation upon multiprocessor architectures, in: Proc. International Conf. Parallel Processing, 1988, pp. 18.
[49]
S. Song, K. Hwang, Y.-K. Kwok, Risk-resilient heuristics and genetic algorithms for security-assured grid job scheduling, IEEE Trans. Comput., 55 (2006) 703-719.
[50]
R. Bajaj, D. Agrawal, Improving scheduling of tasks in a heterogeneous environment, IEEE Trans. Parallel Distrib. Syst., 15 (2004) 107-118.
[51]
I. Ahmad, Y.-K. Kwok, A new approach to scheduling parallel programs using task duplication, in: International Conference on Parallel Processing, 1994. Vol. 1. ICPP 1994. Vol. 2, 1994, pp. 4751.
[52]
Y.-C. Chung, S. Ranka, Applications and performance analysis of a compile-time optimization approach for list scheduling algorithms on distributed memory multiprocessors, in: Supercomputing 92., Proceedings, 1992, pp. 512521.
[53]
C. Boeres, J. Filho, V.E.F. Rebello, A cluster-based strategy for scheduling task on heterogeneous processors, in: 16th Symposium on Computer Architecture and High Performance Computing, 2004. SBAC-PAD 2004. 2004, pp. 214221.
[54]
A. Zomaya, C. Ward, B. Macey, Genetic scheduling for parallel processor systems: comparative studies and performance issues, IEEE Trans. Parallel Distrib. Syst., 10 (1999) 795-812.
[55]
A. Wu, H. Yu, S. Jin, K.-C. Lin, G. Schiavone, An incremental genetic algorithm approach to multiprocessor scheduling, IEEE Trans. Parallel Distrib. Syst., 15 (2004) 824-834.
[56]
M.I. Daoud, N. Kharma, A hybrid heuristicgenetic algorithm for task scheduling in heterogeneous processor networks, J. Parallel Distrib. Comput., 71 (2011) 1518-1531.
[57]
Y. Xu, K. Li, T.T. Khac, M. Qiu, A multiple priority queueing genetic algorithm for task scheduling on heterogeneous computing systems, in: 2012 IEEE 14th International Conference on High Performance Computing and Communication 2012 IEEE 9th International Conference on Embedded Software and Systems, HPCC-ICESS, 2012, pp. 639646.
[58]
S. Ahmad, E. Munir, W. Nisar, Pega: A performance effective genetic algorithm for task scheduling in heterogeneous systems, in: 2012 IEEE 14th International Conference on High Performance Computing and Communication 2012 IEEE 9th International Conference on Embedded Software and Systems, HPCC-ICESS, 2012, pp. 10821087.
[59]
J.E. Gonzalez, R.S. Xin, A. Dave, D. Crankshaw, M.J. Franklin, I. Stoica, GraphX: Graph processing in a distributed dataflow framework, in: OSDI14, USENIX Association, Berkeley, CA, USA, 2014, pp. 599-613.
[60]
Y. Low, D. Bickson, J. Gonzalez, C. Guestrin, A. Kyrola, J.M. Hellerstein, Distributed graphlab: A framework for machine learning and data mining in the cloud, Proc. VLDB Endow., 5 (2012) 716-727.
[61]
M. Isard, M. Budiu, Y. Yu, A. Birrell, D. Fetterly, Dryad: Distributed data-parallel programs from sequential building blocks, in: EuroSys 07, ACM, New York, NY, USA, 2007, pp. 59-72.
[62]
M. Valipour, Optimization of neural networks for precipitation analysis in a humid region to detect drought and wet year alarms, Meteorol. Appl., 23 (2016) 91-100.
[63]
M. Valipour, V.P. Singh, Global experiences on wastewater irrigation: Challenges and prospects, in: Balanced Urban Development: Options and Strategies for Liveable Cities, 2016, pp. 289-327.
[64]
S.I. Yannopoulos, G. Lyberatos, N. Theodossiou, W. Li, M. Valipour, A. Tamburrino, A.N. Angelakis, Evolution of water lifting devices (pumps) over the centuries worldwide, Water, 7 (2015) 5031-5060.
[65]
M. Valipour, Temperature analysis of reference evapotranspiration models, Meteorol. Appl., 22 (2015) 385-394.
[66]
M. Valipour, Comparison of surface irrigation simulation models: Full hydrodynamic, zero inertia, kinematic wave, J. Agric. Sci, 4 (2012) 68.
[67]
C. Brandolese, W. Fornaciari, F. Salice, D. Sciuto, Source-level execution time estimation of C programs, in: Proceedings of the Ninth International Symposium on Hardware/Software Codesign, 2001. CODES 2001. 2001, pp. 98103.
[68]
S. Ali, H. Siegel, M. Maheswaran, D. Hensgen, S. Ali, Task execution time modeling for heterogeneous computing systems, in: Heterogeneous Computing Workshop, 2000. HCW 2000, Proceedings. 9th, 2000, pp. 185199.
[69]
A. Bansal, M. Blake, S. Kona, S. Bleul, T. Weise, M. Jaeger, WSC-08: Continuing the web services challenge, in: 2008 10th IEEE Conference on E-Commerce Technology and the Fifth IEEE Conference on Enterprise Computing, E-Commerce and E-Services, 2008, pp. 351354.
[70]
S. Kona, A. Bansal, M. Blake, S. Bleul, T. Weise, WSC-2009: A quality of service-oriented web services challenge, in: IEEE Conference on Commerce and Enterprise Computing, 2009. CEC 09. 2009, pp. 487490.
[71]
P. Rodriguez-Mier, M. Mucientes, M. Lama, Automatic web service composition with a heuristic-based search algorithm, in: 2011 IEEE International Conference on Web Services, ICWS, 2011, pp. 8188.
[72]
B. Srivastava, J. Koehler, Web service composition - current solutions and open problems, in: ICAPS 2003 Workshop on Planning for Web Services, 2003, pp. 2835.
[73]
C. Peltz, Web services orchestration and choreography, Computer, 36 (2003) 46-52.
[74]
T. Tobita, H. Kasahara, A standard task graph set for fair evaluation of multiprocessor scheduling algorithms, J. Sched., 5 (2002) 379-394.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Future Generation Computer Systems
Future Generation Computer Systems  Volume 78, Issue P3
January 2018
172 pages

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 January 2018

Author Tags

  1. Collision avoidance
  2. Directed acyclic graph
  3. Multiple I/O ports
  4. Task graph
  5. Task scheduling

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media