research-article

A virtual deployment testing environment for enterprise software systems

Authors:

Jean-Guy Schneider,

Steve VersteegAuthors Info & Claims

QoSA '12: Proceedings of the 8th international ACM SIGSOFT conference on Quality of Software Architectures

Pages 101 - 110

https://doi.org/10.1145/2304696.2304714

Published: 25 June 2012 Publication History

Abstract

Modern enterprise software systems often need to interact with a large number of heterogeneous systems in an enterprise IT environment. The distributedness, large-scale-ness, and heterogeneity of such environment makes it difficult to test a system's quality attributes such as performance and scalability before it is actually deployed in the environment. In this paper, we present a Coloured Petri nets (CPN) based system behaviour emulation approach and a lightweight virtual testing framework for provisioning the deployment testing environment of an enterprise system so that its quality attributes, especially scalability, can be evaluated without physically connecting to the real production environment. This testing environment is scalable and has a flexible pluggable architecture to support the emulation of the behaviour of heterogeneous systems in the environment. To validate the feasibility of this approach, a CPN emulation model for LDAP has been developed and applied in testing the scalability of a real-life identity management system. An in-lab performance study has been conducted to demonstrate the effectiveness of this approach.

References

[1]

Apache Software Foundation. Apache Jmeter. http://jakarta.apache.org/jmeter, 2011.

[2]

CA. CA Identity Manager One Hundred Million User Test: Results and Analysis. http://www.ca.com/us/collateral/white-papers/, 2011.

[3]

Alistair Cockburn. Writing Effective Use Cases. Addison-Wesley, 2000.

Digital Library

[4]

S. Freeman, T. Mackinnon, N. Pryce, and J. Walnes. Mock Roles, not Objects. In Companion to the 19th Annual ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications, pages 236--246, 2004.

Digital Library

[5]

J. Gao, H.-S. Tsao, and Y. Wu. Testing and Quality Assurance for Component-Based Software. Artech House, 2003.

Digital Library

[6]

M. Gardiner. CA Identity Manager. White Paper on CA Identity Manager, 2006.

[7]

S. Ghosh and A.P. Mathur. Issues in Testing Distributed Component-Based Systems. In Proceedings of the 1st International ICSE Workshop on Testing Distributed Component-Based Systems, 1999.

[8]

P. Gibbons. A Stub Generator for Multilanguage RPC in Heterogeneous Environments. IEEE Transactions on Software Engineering, 13(1):77--87, 1987.

Digital Library

[9]

C. Hine, J. Schneider, J. Han, and S. Versteeg. Scalable Emulation of Enterprise Systems. In Proceedings of the 20th Australian Software Engineering Conference, pages 142--151, Gold Coast, Australia, 2009.

Digital Library

[10]

C. Hine, J. Schneider, J. Han, and S. Versteeg. Modelling Enterprise System Protocols and Trace Conformance. In Proceedings of the 20th Australian Software Engineering Conference, pages 35--44, Auckland, New Zealand, 2010.

Digital Library

[11]

Cameron Hine. Emulation of Enterprise Software Environments. PhD Thesis - Swinburne University of Technology, 2012. Under Examination, Available at http://quoll.ict.swin.edu.au/doc/chine-phd-thesis-submission.pdf.

[12]

HP. HP LoadRunner Software Data Sheet. www8.hp.com/us/en/software/software-product.html, 2007.

[13]

K. Jensen. Coloured Petri Nets. Basic Concepts, Analysis Methods and Practical Use. Volume 2: Analysis Methods. Springer, 1994.

Digital Library

[14]

K. Jensen, L. M. Kristensen, and L. Wells. Coloured Petri Nets and CPN Tools for Modelling and Validation of Concurrent Systems. Software Tools for Technology Transfer Manuscript, 9(3--4):213--254, 2007.

Digital Library

[15]

Kurt Jensen and Lars M. Kristensen. Coloured Petri Nets: Modeling and Validation of Concurrent Systems. Springer, 2009.

Digital Library

[16]

S. Jones. Haskell 98 Language and Libraries: The Revised Report. Cambridge University Press, 2003.

[17]

Mockery. https://github.com/padraic/mockery, 2011.

[18]

Mockito. http://mockito.org/, 2011.

[19]

W. Reisig. Petri Nets: An Introduction. Springer, 1985.

Digital Library

[20]

Wolfgang Reisig. Petri nets and algebraic specifications. Theoretical Computer Science, 80(1):1--34, March 1991.

Digital Library

[21]

RSpec. http://rspec.info, 2011.

[22]

J. Sermersheim. Lightweight Directory Access Protocol (LDAP): The Protocol. http://www.ietf.org/rfc/rfc4511.txt, 2006.

[23]

J. Sugerman, G. Venkitachalam, and B.-H. Lim. I/O Devices on VMware Workstation Hosted Virtual Machine Monitor. In Proceedings of the General Track: 2002 USENIX Annual Technical Conference, pages 1--14, 2001.

Digital Library

[24]

Sun Microsystems. SLAMD Distributed Load Generation Engine - Release Notes, 2006.

[25]

Steve Versteeg and Cameron Hine. Scaling to the Sky (Reacto). CA Technology Exchange (CATX), Issue 4, May 2012.

[26]

J. Watson. VirtualBox: Bits and Bytes Masquerading as Machines. Linux Journal, 166(1), 2008.

Digital Library

[27]

M. Westergaard and L. M. Kristensen. The Access/CPN Framework: A Tool for Interacting with the CPN Tools Simulator. In Petri Nets 2009, number 313--322 in LNCS, 2009.

Digital Library

[28]

E. J. Weyuker and F. I. Vokolos. Experience with Performance Testing of Software Systems: Issues, an Approach, and Case Study. IEEE Transactions on Software Engineering, 26(12):1147--1156, 2000.

Digital Library

[29]

C. Yuan. Petri Nets: Theory and Applications. Publishing House of Electronics Industry, 2005.

Cited By

Liu JGrundy JAbdelrazek MAvazpour I(2018)A Domain-Specific Modeling Approach for Testing Environment EmulationModel-Driven Engineering and Software Development10.1007/978-3-319-94764-8_12(272-299)Online publication date: 8-Jul-2018
https://doi.org/10.1007/978-3-319-94764-8_12
Lu LLi CYang Y(2017)Research on comprehensive virtualization performance evaluation methodJournal of Intelligent & Fuzzy Systems10.3233/JIFS-16929832:5(3633-3640)Online publication date: 24-Apr-2017
https://doi.org/10.3233/JIFS-169298
Liu JGrundy JAvazpour IAbdelrazek M(2016)A domain-specific visual modeling language for testing environment emulation2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VLHCC.2016.7739677(143-151)Online publication date: Sep-2016
https://doi.org/10.1109/VLHCC.2016.7739677
Show More Cited By

Index Terms

A virtual deployment testing environment for enterprise software systems
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
  2. Software organization and properties
    1. Software system structures
      1. Software system models
        Petri nets

Recommendations

A framework for virtual enterprise operation management

This paper presents researches on operation management for virtual enterprises (VEs). A virtual enterprise is a temporary alliance of member enterprises (MEs) formed to exploit fast-changing opportunities. During the operation of a virtual enterprise, ...
Modeling Dynamic Objects in Distributed Systems with Nested Petri Nets
Concurrency Specification and Programming Workshop (CS&P'2001)

Nested Petri nets (NP-nets) is a Petri net extension, allowing tokens in a net marking to be represented by marked nets themselves. The paper discusses applicability of NP-nets for modeling task planning systems, multi-agent systems and recursive-...
Modeling dynamic objects in distributed systems with nested Petri nets

Nested Petri nets (NP-nets) is a Petri net extension, allowing tokens in a net marking to be represented by marked nets themselves. The paper discusses applicability of NP-nets for modeling task planning systems, multi-agent systems and recursive-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

QoSA '12: Proceedings of the 8th international ACM SIGSOFT conference on Quality of Software Architectures

June 2012

164 pages

ISBN:9781450313469

DOI:10.1145/2304696

General Chairs:
Vincenzo Grassi
Università di Roma Tor Vergata, Italy
,
Raffaela Mirandola
Politecnico di Milano, Italy
,
Program Chairs:
Barbora Buhnova
Masaryk University, Czech Republic
,
Antonio Vallecillo
University of Malaga, Spain

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Comparch '12

Sponsor:

SIGSOFT

Comparch '12: Federated Events on Component-Based Software Engineering and Software Architecture

June 25 - 28, 2012

Bertinoro, Italy

Acceptance Rates

Overall Acceptance Rate 46 of 131 submissions, 35%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
188
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu JGrundy JAbdelrazek MAvazpour I(2018)A Domain-Specific Modeling Approach for Testing Environment EmulationModel-Driven Engineering and Software Development10.1007/978-3-319-94764-8_12(272-299)Online publication date: 8-Jul-2018
https://doi.org/10.1007/978-3-319-94764-8_12
Lu LLi CYang Y(2017)Research on comprehensive virtualization performance evaluation methodJournal of Intelligent & Fuzzy Systems10.3233/JIFS-16929832:5(3633-3640)Online publication date: 24-Apr-2017
https://doi.org/10.3233/JIFS-169298
Liu JGrundy JAvazpour IAbdelrazek M(2016)A domain-specific visual modeling language for testing environment emulation2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VLHCC.2016.7739677(143-151)Online publication date: Sep-2016
https://doi.org/10.1109/VLHCC.2016.7739677
Danielewicz-Betz ADanielewicz-Betz A(2016)Enterprise Software or Tools: Terminology and Communication ProcessesCommunicating in Digital Age Corporations10.1057/978-1-137-55813-8_2(55-80)Online publication date: 25-Nov-2016
https://doi.org/10.1057/978-1-137-55813-8_2
Jiménez MGómez ÁVillegas NTamura GDuchien L(2014)A Framework for Automated and Composable Testing of Component-Based ServicesProceedings of the 2014 IEEE 8th International Symposium on the Maintenance and Evolution of Service-Oriented and Cloud-Based Systems10.1109/MESOCA.2014.9(1-10)Online publication date: 29-Sep-2014
https://dl.acm.org/doi/10.1109/MESOCA.2014.9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents