article

Virtual workflow system for distributed collaborative scientific applications on Grids

Authors:

Fang HuangAuthors Info & Claims

Computers and Electrical Engineering, Volume 37, Issue 3

Pages 300 - 310

https://doi.org/10.1016/j.compeleceng.2011.01.004

Published: 01 May 2011 Publication History

Abstract

Grid computing has become an effective computing technique in recent years. This paper develops a virtual workflow system to construct distributed collaborative applications for Grid users. The virtual workflow system consists three levels: abstract workflow system, translator and concrete workflow system. The research highlight of the implementation is that this workflow system is developed based on CORBA and Unicore Grid middleware. Furthermore, this implementation can support legacy application developed with Parco and C++ codes. This virtual workflow system can provide efficient GUI for users to organize distributed scientific collaborative applications and execute them on Grid resources. We present the design, implementation, and evaluation of this virtual workflow system in the paper.

References

[1]

Foster, I., Kesselman, C. and Tuecke, S., The anatomy of the grid: enabling scalable virtual organizations. Lect Notes Comput Sci. v2150.

[2]

Zhu, H., Chan, T.K.Y., Wang, L., Cai, W. and See, S., A prototype of distributed molecular visualization on computational grids. Future Gen Comput Syst. v20 i5. 727-737.

[3]

Unicore Project. Web page; May 2010. Available from: http://www.unicore.eu/.

[4]

D-grid Project. Web page; May 2010. Available from: http://www.dgrid.de/.

[5]

Document. Workflow management coalition terminology glossary; 1999. Available from: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.39.4481.

[6]

Senger M, Rice P, Oinn T. The workflow reference model: 10 years on. Future Strategies Inc. Available from: http://www.amazon.com/exec/obidos/redirect?tag=citeulike07-20&path=ASIN%/0970350961.

[7]

Wang, L., Zhu, H. and Jie, W., State of the arts: workflow system for grid computing. 2006. WIT Press.

[8]

Frey, J., Tannenbaum, T., Livny, M., Foster, I.T. and Tuecke, S., Condor-g: a computation management agent for multi-institutional grids. Cluster Comput. v5 i3. 237-246.

[9]

Deelman, E., Blythe, J., Gil, Y. and Kesselman, C., Grid resource management. 2003. Kluwer.

[10]

Taylor, I., Shields, M., Wang, I. and Harrison, A., Visual grid workflow in Triana. J Grid Comput. v3 i3. 153-169.

[11]

Fahringer, T., Jugravu, A., Pllana, S., Prodan, R., Seragiotto, C. and Truong, H., ASKALON: a tool set for cluster and grid computing. Concurrency Comput Pract Ex. v17 i2. 143-169.

[12]

Foster I, Voeckler J, Wilde M, Zhao Y. Chimera: a virtual data system for representing, querying, and automating data derivation. In: Proceedings of the 14th conference on scientific and statistical database management; 2002. p. 37-46

Digital Library

[13]

Blythe J, Deelman E, Gil Y. Planning for workflow construction and maintenance on the grid. Tech. Rep. Marina del Rey, CA 90292, USA: USC Information Sciences Institute; 2003. Available from: http://www.isi.edu/deelman/Pegasus/icaps_workshop.pdf.

[14]

Fraunhofer Resource Grid Project. Web page; May 2008. Available from: http://www.fhrg.fhg.de/index_en.html/.

[15]

Fahringer, T., Jugravu, A., Pllana, S., Prodan, R., Seragiotto Jr., C. and Truong, H., ASKALON: a tool set for cluster and grid computing. Concurrency Comput Pract Ex. v17 i2-4. 43-169.

[16]

Amin K, Hategan M, von Laszewski G, Zaluzec NJ, Hampton S, Rossi A. GridAnt: a client-controllable grid workflow system. In: 37th Hawai'i international conference on system science, Island of Hawaii, Big Island; 5-8 January 2004.

[17]

Dornemann T, Friese T, Herdt S, Juhnke E, Freisleben B. Grid workflow modelling using grid-specific BPEL Extensions. In: Proceedings of German e-Science conference, Baden-Baden; 2007.

[18]

Krishnan S, Wagstrom P, von Laszewski G. GSFL: a workflow framework for grid services. In: Preprint ANL/MCS-P980-0802. 9700 S. Cass Avenue, Argonne, IL 60439, USA: Argonne National Laboratory; 2002. Available from: http://www-unix.globus.org/cog/papers/gsfl-paper.pdf.

[19]

Fahringer T, Qin J, Hainzer S. Specification of grid workflow applications with A-WGL: an abstract grid workflow language. In: Proceedings of the 5th international symposium on cluster computing and the grid; 2005. p. 676-85.

[20]

Vargas-Lombardo M, Jipsion A, Arredondo MT. A framework for the quality of data in data grid systems for virtual organizations. In: Proceedings of the 2009 international conference on grid computing and applications; 2009. p. 59-64.

[21]

Abramson, D., Enticott, C. and Altinas, I., Nimrod/k: towards massively parallel dynamic grid workflows. In: SC '08: proceedings of the 2008 ACM/IEEE conference on supercomputing, IEEE Press, Piscataway, NJ, USA. pp. 1-11.

[22]

Wang L, Cai W. Bio-grid computing platform: parallel computing for protein alignment analysis. In: Proceedings of the international conference on high performance computing in Asia Pacific Region; 2002. p. 367-70.

[23]

Zhu, H., Chan, T.K.Y., Wang, L. and Jegathese, R.C., A distributed 3d rendering application for massive data sets. IEICE Trans Inform Syst. vE87-D i7. 1805-1812.

[24]

Abramovici, A., Althouse, W.E., Drever, R.W., Gursel, Y., Kawamura, S. and Raab, F.J., Ligo: the laser interferometer gravitational-wave observatory. Science. v256 i5055. 325-333.

[25]

CERN. LHC Computing Grid Project. Web page; 2003. Available from: http://lcg.web.cern.ch/LCG/.

[26]

DARPA Agent Markup Language for the Semantic Web. Web page; May 2010. Available from: htpp://www.daml.org/services/.

[27]

Business Process Execution Language. Web page; May 2010. Available from: http://www.ibm.com/developerworks/library/specification/ws-bpel/.

[28]

CAST. Web page; May 2010. Available from: http://cast.sf.net/.

[29]

Puder, A., Mico: an open source CORBA implementation. IEEE Softw. v21 i4. 17-19.

[30]

Denis, A., Pérez, C. and Priol, T., Achieving portable and efficient parallel CORBA objects. Concurrency Comput Pract Ex. v15 10. 891-909.

Cited By

Chen XChen YZomaya ARanjan RHu S(2016)CEVPThe Journal of Supercomputing10.1007/s11227-016-1630-172:8(3194-3209)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1007/s11227-016-1630-1
Hameed AKhoshkbarforoushha ARanjan RJayaraman PKolodziej JBalaji PZeadally SMalluhi QTziritas NVishnu AKhan SZomaya A(2016)A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systemsComputing10.1007/s00607-014-0407-898:7(751-774)Online publication date: 1-Jul-2016
https://dl.acm.org/doi/10.1007/s00607-014-0407-8
Yang CShih WHuang CJiang FChu W(2016)On construction of a distributed data storage system in cloudComputing10.1007/s00607-014-0399-498:1-2(93-118)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1007/s00607-014-0399-4
Show More Cited By

Virtual workflow system for distributed collaborative scientific applications on Grids
1. Computer systems organization
  1. Architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures

Recommendations

Scheduling scientific workflow applications in computational grids
A scientific workflow system for genomic data analysis
A Distributed Workflow Management System with Case Study of Real-life Scientific Applications on Grids

Next-generation scientific applications feature complex workflows comprised of many computing modules with intricate inter-module dependencies. Supporting such scientific workflows in wide-area networks especially Grids and optimizing their performance ...

Comments

Information & Contributors

Information

Published In

cover image Computers and Electrical Engineering

Computers and Electrical Engineering Volume 37, Issue 3

May, 2011

163 pages

ISSN:0045-7906

Issue’s Table of Contents

Copyright © Elsevier Ltd © 2011.

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 May 2011

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen XChen YZomaya ARanjan RHu S(2016)CEVPThe Journal of Supercomputing10.1007/s11227-016-1630-172:8(3194-3209)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1007/s11227-016-1630-1
Hameed AKhoshkbarforoushha ARanjan RJayaraman PKolodziej JBalaji PZeadally SMalluhi QTziritas NVishnu AKhan SZomaya A(2016)A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systemsComputing10.1007/s00607-014-0407-898:7(751-774)Online publication date: 1-Jul-2016
https://dl.acm.org/doi/10.1007/s00607-014-0407-8
Yang CShih WHuang CJiang FChu W(2016)On construction of a distributed data storage system in cloudComputing10.1007/s00607-014-0399-498:1-2(93-118)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1007/s00607-014-0399-4
Yang CShih WChen LKuo CJiang FLeu F(2015)Accessing medical image file with co-allocation HDFS in cloudFuture Generation Computer Systems10.1016/j.future.2014.08.00843:C(61-73)Online publication date: 1-Feb-2015
https://dl.acm.org/doi/10.1016/j.future.2014.08.008
Zhao JMhedheb YTao JJrad FLiu QStreit A(2014)Using a vision cognitive algorithm to schedule virtual machinesInternational Journal of Applied Mathematics and Computer Science10.2478/amcs-2014-003924:3(535-550)Online publication date: 1-Sep-2014
https://dl.acm.org/doi/10.2478/amcs-2014-0039
Zhao JTao JFürlinger K(2014)A framework for comparative performance study on virtualised machinesInternational Journal of Ad Hoc and Ubiquitous Computing10.1504/IJAHUC.2014.06577217:2/3(82-99)Online publication date: 1-Nov-2014
https://dl.acm.org/doi/10.1504/IJAHUC.2014.065772
Cao FZhu M(2013)Distributed workflow mapping algorithm for maximized reliability under end-to-end delay constraintThe Journal of Supercomputing10.1007/s11227-013-0938-366:3(1462-1488)Online publication date: 1-Dec-2013
https://dl.acm.org/doi/10.1007/s11227-013-0938-3

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents