psqt00south-1.gif (2282 bytes)

Software Dimensions and The International Institute for Software Testing

Present

PSQT/PSTT 2001 North

spacer.gif (849 bytes)
psqtleft.gif (1883 bytes)
spacer.gif (849 bytes)
calls.gif (2148 bytes)
spacer.gif (849 bytes)
Registration.gif (2258 bytes)
spacer.gif (849 bytes)
program.gif (2139 bytes)
spacer.gif (849 bytes)
winfree.gif (2459 bytes)
spacer.gif (849 bytes)
committee.gif (2228 bytes)
spacer.gif (849 bytes)
sponsors.gif (1588 bytes)
spacer.gif (849 bytes)
vendors.gif (1302 bytes)
spacer.gif (849 bytes)
archive.gif (1510 bytes)
spacer.gif (849 bytes)
softdim.gif (2173 bytes)
spacer.gif (849 bytes)
bottom.gif (1023 bytes)

 

Tutorials: Series W
Wednesday, October 10th, 2001

Two concurrent tutorials taught by nationally recognized quality experts. Each tutorial is a one full day of an in-depth instruction in a specific software quality topic.

You must specify which tutorial you wish to attend (W1 through W2)

Tutorials marked with (CSTP) will count as one day of training towards the requirements for the Certified Software Testing Professional

W1 Discovering REAL Requirements for Web and eBusiness Systems (Intermediate) (CSTP, #5) Robin F. Goldsmith JD
W2 A Methodology for Software Test Automation (Intermediate) (CSTP, #6) Elfriede Dustin

Or PSQT/PSTT Conference Sessions

Keynote Howard Rubin
How Do You Know When You Are Done Tesing? Scott Jefferies
Topic to be Determined Mark Blackburn
Common Mistakes in Software Testing Dorothy Graham
Project Out of Control? 10 Easy Metrics You Can Begin Using Today Judy Bamberger
16 Track Presentations
The Software Quality Summit

blue_dot.gif (867 bytes)    Series M - Monday, October 8, 2001

blue_dot.gif (867 bytes)    Series T - Tuesday, October 9, 2001

blue_dot.gif (867 bytes)    Series H - Thursday, October 11, 2001

blue_dot.gif (867 bytes)    Series F - Friday, October 12, 2001   


Tutorial #W1 (Wednesday 8:30 - 4:30 p.m.)

W1: Discovering REAL Requirements for Web and eBusiness Systems (Intermediate) (CSTP, #5)

Robin F. Goldsmith JD

This tutorial counts as one day of training towards the Certified Software Test Professional requirements.

Web sites seem simple.  That’s a strength.  It’s also a trap.  Just ask the “dot.bombs” that failed in droves. Many of them built seemingly fine Web sites that people either didn’t visit or visited and left, never to return.  Even for conventional organizations, Web and eBusiness success depends mainly upon accurately understanding business and user requirements as well as Web-specific technology requirements that the Web site must satisfy.  That’s not simple; and the illusion of simplicity vastly increases the risks that the rush of Internet time will cause requirements errors.  This interactive workshop helps systems professionals become aware of requirements issues and techniques to quickly discover the REAL requirements that Web systems must meet to provide value.  The workshop  will also  address issues related to system requirements for non-web systems.  Exercises with a real case assist learning.

 Participants will learn:

        Importance of distinguishing business, technical, and system/software requirements.

       Web and eBusiness technology issues that must be addressed.

       Using the Problem Statement tool to discover the real business requirements.

       Techniques for gathering and analyzing data in order to understand what is required.

       Formats for documenting and communicating business and functional requirements.

 WHO SHOULD ATTEND:  This course has been designed for systems and business managers, project leaders, analysts, developers, and quality/testing professionals responsible for assuring requirements are defined adequately.

 REQUIREMENTS ROLE AND IMPORTANCE

        Requirements, design, and value

        What it takes for Web success

        Where eBusinesses have tended to fail

        Content, form, and stickiness

        Illusion of simplicity and Internet time

        Business requirements, what produces value

        Functional specifications, external view

        Use cases, how actors interact with system

        Recognizing common traps

        Iterative development models and myths

DISCOVERING BUSINESS REQUIREMENTS

        Do users really not know what they want?

        What they say is not what they really need

        Why we must be detectives, not gatherers

        Finding the value, or it’s not a requirement

        Where requirements fit in the process

        Understanding the business needs/purposes

        Problem statement tool to get on track

        Identifying the “real” problem and causes

        Guidelines for avoiding wrong turns

        Scaling to frequent small Web changes

        Aligning strategy, management, operations

        Maintaining customer focus to avoid silos

        Technology requirements vs. design

        Data gathering strategies and techniques

        Management/supervisor vs. worker views

        Questions to ask

 UNDERSTANDING BUSINESS NEEDS

        Business rules, structured English

        E-R, data flow, flow, organization diagrams

        Data models, process maps

        Performance, volume, frequency statistics

        Sample forms, reports, screens, menus

WEB TECHNOLOGY REQUIREMENTS

        Browser compatibilities

        Configuration capacities

        Factors affecting download time

        Content and navigation

        Coordination with traditional media

        Keeping data fresh and up-to-date

        Dynamic vs. static pages

        Links to other sites

        Interfaces with middleware

        Accessing legacy systems and data

        Security issues

        Load and performance

DOCUMENTING REQUIREMENTS

        Formats for communicating requirements

        IEEE standard for software requirements

        Use cases, strengths and warnings

        7 guidelines for documenting requirements

        Top-level requirements and project scope

        Iterating to avoid analysis paralysis

        Conceptual system design solutions

        Expanding to detailed deliverables           

 Top of Page Tutorials: Series W


Tutorial #W2 (Wednesday 8:30 - 4:30 p.m.)

W2: A Methodology for Software Test Automation
            (Intermediate) (CSTP, #6)

Elfriede Dustin

This tutorial counts as one day of training towards the Certified Software Test Professional requirements.

This tutorial outlines the Automated Test Life-cycle Methodology, a structured process for designing, developing, executing and managing testing that parallels the System Development Life-cycle. It is based on the book titled "Automated Software Testing" co-authored by the instructor and published by AWL, ISBN 0-201-43287-0.


Automated Testing Life-Cycle Methodology

How test teams introduce an automated software test tool on a new project is nearly as important as the selection of the most appropriate test tool for the project. A tool is only as good as the process being used to implement the tool.

Over the last several years test teams have largely implemented automated testing tools on projects, without having a process or strategy in place describing in detail the steps involved in using the test tool productively. This approach commonly results in the development of test scripts that are not reusable, meaning that the test script serves a single test string but cannot be applied to a subsequent release of the software application. In the case of incremental software builds and as a result of software changes, these test scripts need to be recreated repeatedly and must be adjusted multiple times to accommodate minor software changes. This approach increases the testing effort and brings subsequent schedule increases and cost overruns.

The fallout from a bad experience with a test tool on a project can have a ripple effect throughout an organization. The experience may tarnish the reputation of the test group. Confidence in the tool by product and project managers may have been shaken to the point where the test team may have difficulty obtaining approval for use of a test tool on future efforts. Likewise, when budget pressures materialize, planned expenditures for test tool licenses and related tool support may be scratched.

By developing and following a strategy for rolling out and implement an automated test tool as part of the Automated Testing Life-cycle methodology, the test team can avoid having to make major unplanned adjustments throughout the test process. The tutorial "Automated Software Testing" addresses these various issues and their solutions.

The ATLM describes how and where "Automated Software Testing" fits into the system development life-cycle.


This tutorial will cover the following topics:

  1. Overcoming False Expectations for Automated Test. This part of the tutorial will address the false expectations that automated testing will result in :
    • Automatic Test Plan Generation
    • Test Tool Fits All
    • Immediate Test Effort reduction
    • Immediate Schedule Reduction
    • 100% Test Coverage
  2. Outline Benefits of Automated test. This part of the tutorial will address the actual benefits of automated testing:
    • Production of a reliable System
    • Improvement of the quality of effort
    • Reduction of Test Effort and Minimization of Schedule
    • Some tests cannot be executed unless they are automated
  3. Acquiring Management Support.  This part of the tutorial will address how to best acquire management support (i.e writing a proposal, content of the proposal, how to convince management, etc.)
  4. Acquiring Tools. This part of the tutorial will address how to acquire an automated tool.
    • Review System Engineering Environment
    • Review Tools Available on the market
    • Tool Research and Evaluation
    • Reviewing the Test Life-Cycle Tools
    • Tool Purchase
  5. Automated Testing Introduction Process. This part of the tutorial will address how to best introduce automated testing to a new project team, including:
    • Test Process Analysis
    • Process Overview
    • Goals and Objectives of Testing
    • Test Strategies
    • Test Tool Consideration
    • Test tool compatibility check
    • Review of Training requirements
    • Test Team Recruiting and Management
  6. Test Planning, Design and Development. This part of the tutorial will address how to best address test planning, design and development of tests in an automated testing environment, to include:
    • Test plan documentation
    • Test Program Scope
    • Test Requirement Management
    • Test Environment
    • Test requirements Analysis
    • Development-Level Test Analysis
    • System-Level Test Analysis
    • Test Program Design
      • Review Test program design modules
      • White-Box Techniques ( Development-LevelTests)
      • Black-Box Techniques ( System-LevelTests)
      • Test Design Documentation – examples of Test Design using Orthogonal Array Testing Techniques.
      • Test procedure definition
      • Automated vs Manual Test Analysis – what to automate and what not to
      • Automated Test design standards
    • Test Development
      • Set up Test Environment
      • Automation Framework Reuse Analysis
      • Test Procedure Development/Execution Schedule
      • Calibration of the test tool
      • Compatibility and work around solutions
      • Manual Execution of Test Procedures
      • Test Procedure inspections and Peer reviews
      • Test Procedure Configuration management
      • Reusable Test procedures
  7. Automated Test Execution and Management of it. This part of the tutorial will address how to best address automated test execution and the management of the testing execution cycle, to include:
    • Unit Test Execution and Evaluation
    • Integration Test Execution and Evaluation
    • System Test Execution and Evaluation
    • Test Analysis of Regression Testing
    • User Acceptance Test Execution and Evaluation
    • Testbed baseline
    • Creating Baseline data
    • Tools to Generate Data
      • Defect Tracking
      • Identify the priority of a defect
      • Assign a unique identifier to each defect
      • Link each defect to test procedure/build
      • Log all the appropriate dates for tracking
      • Create metrics for Defect Management
      • Test progress Tracking
      • Test Metrics
  8. Post release. Test Process Improvement – This part of the tutorial will address the post release and evaluation period and how to improve the test process, to include:
    • Documenting Lessons learned
    • What worked and what did not?
    • How would you do things differently?
    • Reviewing standards for future projects

Various companies throughout the world have adopted the ATLM and incorporated it into their project.


Learning Objective

  • Best practices for test automation
  • A Case Study will be presented that covers how the ATLM was implemented on one particular project. This case study will address each phases of the Automated Testing Life-cycle. Students can bring their own project specific problems, which can be addressed during the tutorial.
  • Acquiring management support
  • Test tool evaluation and selection
  • The automated testing introduction process
  • Various tools used during the various life-cycle phases (i.e. Rational Rose during Architecture phase, ReqPro or DOORS during Requirements Management, Robot or Winrunner during Test Execution Phase, Performance Studio or E-Suite for performance testing)
  • Automated and manual test planning and preparation
  • Test procedure development guidelines
  • Automation reuse analysis and reuse library

 

Elfriede Dustin is a SQA Certified test engineer and has supported test efforts for a multitude of applications. She is frequently a speaker at various Quality Assurance and Software Test Conferences. Elfriede has a BS degree in Computer Science and has performed as a Computer Systems Analyst/Programmer developing software applications and utilities, process and data modeling using CASE tools, and system design simulation models. 

In support of software test efforts, Elfriede has been responsible for implementing automated test, or has performed as the lead consultant guiding the implementation of automated software test.  Elfriede has lead the successful rollout of automated testing tools at three companies, and has applied her rollout strategy on over nine different projects.

Elfriede Dustin is the lead author of the best-selling book "Automated Software Testing", published by Addison-Wesley Pub Co; ISBN: 0201432870, July 1999. The book has been getting excellent reviews throughout the testing community (see also www.amazon.com).

 

 

Top of Page Tutorials: Series W