Logo des Repositoriums

P058 - Testing of Component-Based Systems and Software Quality 2004

https://dl.gi.de/handle/20.500.12116/28483
Auflistung nach:

Auflistung P058 - Testing of Component-Based Systems and Software Quality 2004 nach Erscheinungsdatum

Zu einem Punkt im Index springen:
1 - 10 von 18
  • Konferenzbeitrag
    Scenario-based component testing using embedded metadata
    (Testing of component-based systems and software quality, 2004) Strembeck, Mark; Zdun, Uwe
    We present an approach for the use case and scenario-based testing of software components. Use cases and scenarios are applied to describe the functional requirements of a software system. In our approach, a test is defined as a formalized and executable description of a scenario. Tests are derived from use case scenarios via continuous refinement. The use case and test information can be associated with a software component as embedded component metadata. In particular, our approach provides a model-based mapping of use cases and scenarios to test cases, as well as (runtime) traceability of these links. Moreover, we describe an implementation-level test framework that can be integrated with many different programming languages.
  • Konferenzbeitrag
    Measuring component performance using a systematic approach and environment
    (Testing of component-based systems and software quality, 2004) Gao, Jerry; Ravi, Chandra S.; Raquel, Espinoza
    As more third-party software components are available in the commercial market, more people begin to use the component-based software engineering approach to developing component-based programs. Since most e-business and e-commerce application systems are net-centered distributed systems, customers usually have very restricted system performance requirements. Hence, performance testing and evaluation of software components becomes a critical task for component-based software. Although a lot of research efforts have been devoted to analysis and design methods of component-based software, only a few research papers address the issues and systematic solutions to performance testing and measurement for modern components. This paper proposes a systematic solution and environment to support performance measurement for software components. The objective is to provide a plug-in-and-measure approach to evaluate component performance, including functional speed, throughput, availability, reliability and resource utilization. It reports the development effort on constructing a distributed performance evaluation environment for software components based on a set of well-defined performance evaluation metrics and techniques. In addition, some application examples and case study results are reported.
  • Konferenzbeitrag
    Measuring the effectiveness of software testing
    (Testing of component-based systems and software quality, 2004) Sneed, Harry M.
    In 1978 Harry Sneed set up the first commercial software test laboratory in Budapest charging DM 75,- per test case and DM 100,- for each error found. The laboratory was used to test the Integrated Transport Steuerung system of the German railroad and the BS2000 operating system of Siemens. Today, some 26 years later, managers are looking for a means to justify the cost of testing. While working as a test consultant for a Viennese software house from 1998 until 2003, Harry Sneed conceived a set of metrics for measuring the effectiveness of the test operations there. These metrics were intended to measure the performance of the test department, but they are equally valid for measuring test operations anywhere. In fact, with these metrics it should be possible to convert software testing from an art as perceived by Glenford Meyers in 1975 to a science as defined by Lord Kelvin in 1875. The metrics were obtained using the Goal/Question/Metric Method of Basili and Rombach and were refined through three years of practical application. In effect, they are a continuation of the test measurement work Sneed began as a young test entrepreneur in 1978. They are supported by a set of tools designed for both static and dynamic analysis as well as for evaluating the results of both. Working as a test team leader at the Wirtschaftskammer in Vienna, Sneed applied these metrics to successfully predict the test effort required to test a complex web application. From this presentation the attendants will be exposed to the experience of 30 years of software testing.
  • Konferenzbeitrag
    An aspect-based environment for COTS component testing
    (Testing of component-based systems and software quality, 2004) Polo, Macario; Cechich, Alejandra
    Component qualification is one of the major steps in the development of component-based applications. Several techniques are used to enrich documentation by structuring and classifying components' metadata. In that line, aspect information has been used to help implement better component interfaces and to encode knowledge of components' capabilities. In this paper, we describe an environment to generate and execute aspect-dependent test cases, which is based on an aspect-based categorisation of information for testing.
  • Konferenzbeitrag
    Test oracles using statistical methods
    (Testing of component-based systems and software quality, 2004) Mayer, Johannes; Guderlei, Ralph
    The oracle problem is addressed for random testing and testing of randomized software. The presented Statistical Oracle is a Heuristic Oracle using statistical methods, especially statistical tests. The Statistical Oracle is applicable in case there are explicit formulae for the mean, the distribution, and so on, of characteristics computable from the test result. However, the present paper only deals with the mean. As with the Heuristic Oracle, the decision of the Statistical Oracle is not always correct. An example from image analysis is shown, where the Statistical Oracle has successfully been applied.
  • Editiertes Buch
  • Konferenzbeitrag
    SIP robustness testing for large-scale use
    (Testing of component-based systems and software quality, 2004) Wieser, Christian; Laakso, Marko
    The Session Initiation Protocol (SIP) is a signaling protocol for Internet telephony, multimedia conferencing and instant messaging. We describe a method for assessing the robustness of SIP implementation by means of a tool that detects vulnerabilities. We prepared the test material and carried out the tests against a sample set of existing implementations. Many of the implementations available failed to perform in a robust manner under the test. Some failures had information security implications and should hence be considered as vulnerabilities. The results were reported to the respective vendors and, after a grace period, the test suite is now publicly available. By releasing the test material to the public, we hope to contribute to more robust SIP implementations.
  • Konferenzbeitrag
    Inspections in small projects
    (Testing of component-based systems and software quality, 2004) Iisakka, Juha
    Practically all inspection and review methods focus on projects for developing new software that involve numerous people, but software companies also have small projects on which only a few people are working, e.g. maintenance-oriented changes to existing software systems. Unfortunately, these small projects do not necessarily have the power to implement inspections efficiently. This paper raises certain problems that small projects have with inspections and discusses how different forms of inspection are suitable for small projects.
  • Konferenzbeitrag
    Property-oriented testing: An approach to focusing testing efforts on behaviours of interest
    (Testing of component-based systems and software quality, 2004) Li, Shuhao; Qi, Zhichang
    The behaviours of reactive systems are characterized by events, conditions, actions, and information flows. Complex reactive systems further exhibit hierarchy and concurrency. Since there usually exist numerous behaviours in such systems, they can hardly receive both comprehensive and in-depth testing. This paper presents a property-oriented testing method for reactive systems. UML state machine is employed to model the system under test (SUT) and temporal logic is used to specify the property to be tested. Targeted test sequences are derived from the model according to the given property. Based on this method, a property-oriented testing tool is implemented. Experiment results indicate that testing efforts can be focused on behaviours of interest of the SUT and thus usually only a small portion of the total behaviours needs to be tested. This method suits well the occasions when the testers have to focus on only critical properties of the SUT in case limited project budget is available. After appropriate extensions, this method can also be applied to real-time systems and systems with parameterized events.
  • Konferenzbeitrag
    Towards a practical approach to test aspect-oriented software
    (Testing of component-based systems and software quality, 2004) Zhou, Yuewei; Ziv, Hadar; Richardson, Debra
    Aspect-Oriented Programming (AOP) provides new constructs and tools to handle cross-cutting concerns in programs. Fully realizing the potentials of Aspect-Oriented Software Development requires new abstractions and techniques for testing. This paper proposes a first step towards a practical approach to test aspect-oriented software. The proposed approach is accompanied by a selection algorithm that can select test cases that are relevant to aspects under test. A new testing coverage definition is proposed to specify the sufficiency of test cases on the aspect being tested. A tool is developed to support the approach, automating test case selection and coverage calculation. A detailed case study of banking account processing illustrates this initial approach.