psqt00south-1.gif (2282 bytes)

Software Dimensions and The International Institute for Software Testing

Present

PSQT/PSTT 2002 South

spacer.gif (849 bytes)
psqtleft.gif (1883 bytes)
spacer.gif (849 bytes)
calls.gif (2148 bytes)
spacer.gif (849 bytes)
Registration.gif (2258 bytes)
spacer.gif (849 bytes)
program.gif (2139 bytes)
spacer.gif (849 bytes)
winfree.gif (2459 bytes)
spacer.gif (849 bytes)
committee.gif (2228 bytes)
spacer.gif (849 bytes)
sponsors.gif (1588 bytes)
spacer.gif (849 bytes)
vendors.gif (1302 bytes)
spacer.gif (849 bytes)
archive.gif (1510 bytes)
spacer.gif (849 bytes)
softdim.gif (2173 bytes)
spacer.gif (849 bytes)
bottom.gif (1023 bytes)

 

Tutorials: Series H
Thursday, March 7th, 2002

Six concurrent tutorials taught by nationally recognized quality experts. Each tutorial is a one full day of an in-depth instruction in a specific software quality topic.

You must specify which tutorial you wish to attend (H1 through H6)

Tutorials marked with (CSTP) count towards the Certified Software Test Professional and cover the Body of Knowledge areas as indicated.

 

H1 Testing Business Requirements (Basic) (CSTP, #5) Robin F. Goldsmith JD
H2 Effective Test Design (Intermediate)(CSTP, #2) Dr. Magdy Hanna
H3 Principles of Software Test Automation
(Basic) (CSTP, #6)     
Jamie Mitchell
H4 Software Inspections and Reviews for QA Professionals
(Basic) (CSTP, #7)
Dr. Rebecca Staton-Reinstein
H5 Testing Web and eBusiness Applications: Advanced Techniques (Advanced) (CSTP, Elective) Ross Collard
H6 Effective Estimating and Planning Techniques Workshop
(Intermediate)
Bob Galen

blue_dot.gif (867 bytes)    Series M - Monday, March 4, 2002

blue_dot.gif (867 bytes)    Series T - Tuesday, March 5, 2002

blue_dot.gif (867 bytes)    Series W - Wednesday, March 6, 2002

blue_dot.gif (867 bytes)    Series F - Friday, March 8, 2002   


Tutorial #H1 (Thursday 8:30 - 4:30 p.m.)

H1: Testing Business Requirements (Basic) (CSTP, #5)

Robin F. Goldsmith JD

Poorly defined requirements cause up to two-thirds of software errors, yet few organizations know effective methods to assure requirements are accurate and complete.  At most, they use one or two weak methods and don’t recognize the weakness.  This interactive session introduces 21 methods with increasing power.  Following the CAT-Scan ApproachÔ, participants apply the techniques successively to a real case and discover how each different method reveals additional, otherwise-overlooked defects when they are easiest and least expensive to fix. Participants learn ways to find previously overlooked requirements, increase meaningful customer/user involvement, enhance communications and understanding, and truly test the adequacy of requirements definitions. 

This course shows ways to test requirements after they have been collected.

It is not intended to teach how to collect requirements,

although the testing methods suggest collection methods which would be helpful.

Our companion course, Defining and Managing User Requirements,

does concentrate on teaching how to collect, analyze, and document requirements. 

Participants will learn: 

       21 ways to test that business/user requirements are accurate and complete.
Finding previously overlooked problems when they are easiest and least expensive to fix.

        Recognizing, communicating, and gaining commitment to the importance of adequate requirements.       

       Evaluating the levels of quality embodied within the requirements.
Testing techniques that enhance customers' involvement and communication with management.
Allocating testing resources economically.

WHO SHOULD ATTEND:  This course has been designed for systems and business managers, project leaders, analysts, programmer analysts, quality/testing professionals, and auditors responsible for assuring the accuracy and completeness of business/customer requirements.

VALUE OF TESTING UP-FRONT

        Overcoming obstacles to improvement
        Role of requirements in system problems
        Big economic payoff of better requirements
        Proactive Testing
Ô Life Cycle Model
        Survey on improving requirements quality
        Keys to effective testing
        Why up-front testing usually is so weak
        CAT-Scan Approach
Ô secret to quality 

 TESTING REQUIREMENTS FORMATS

        The “Regular Way” we review requirements
        Hidden weaknesses of traditional methods
        Adding strength to subjective evaluations
        Formal technical review
        Inspection topics and standards
        Making sure they are requirements
        Assessing reviewability
        Determining deliverability
        Demonstrating testability
        Testing structural completeness and clarity
        Format for requirements deliverables

FINDING OVERLOOKED REQUIREMENTS

        What we mean by system quality
        Identifying all the stakeholders
        Detecting all three Quality Dimensions
        Design, Performance, Conformance needed
        Addressing relevant quality factors
        Candidate quality factor requirements
        Commonly overlooked deliverables 

ASSURING ACCURACY/COMPLETENESS

        Checking importance and criticality
        Finding Engineered Deliverable Quality
Ô
        Guidelines and conventions vs. IT standards
        Engineering standards to do a job well
        Ascertaining trade-off balances

       Simulation and prototyping
        Walking through requirements
        Joint Application Development (JAD)
        Defining acceptance criteria
        Matching to independent definitions
        Independent/expert validation
        Measuring the "proof of the pudding"

Robin Goldsmith JD is internationally recognized as an authority on business engineering and software acquisition/development quality, testing, and productivity.  He is a frequent speaker at leading conferences and formerly International Vice President of the Association for Systems Management.

Top of Page Tutorials: Series H


Tutorial #H2 (Thursday 8:30 - 4:30 p.m.)

H2: Effective Test Design (Intermediate) (CSTP, #2)

Dr. Magdy Hanna

This tutorial counts as one day of training towards the Certified Software Test Professional requirements.

This course will cover the test design phase of the testing lifecycle.   It starts with coverage of test case design techniques both for black and glass box testing.  This includes Equivalence Class partitioning, Boundary Value Analysis, Cause-Effect Diagram, and Decision Tables.  The second part of the course will cover test design activities and writing Test Design Specification including documenting test conditions, test cases, test scripts and procedures, and expected results.

Presentation Outline:

1. Test Case Design Techniques

Strategies for generating test cases
Black Box testing
Equivalence Class Partitioning
Boundary Value Analysis
Cause-Effect Diagram
Decision Tables
Glass Box testing
Statement/decision/condition coverage
Path coverage
Program complexity and basis path coverage
 

2.   System Test Planning

        Why plan
Developing a test strategy
Components of a test plan
A test plan template
Creating a systems test plan 

3.   Systems Test Design

        Test design basics
    Test design activities
    Deliverables of the test design phase
    Conditions and test cases

    Procedures and expected results
    Major areas of system testing
    Business requirement testing
Preparing the Test Design Specification
    Defining test conditions
   Testing for missing business requirements
   Defining test cases
   Identifying data needed to execute tests
   Defining baseline data
   Determining expected results
   Defining test cycles
    A Systems Test Specification template
 

Biography:

Dr. Magdy Hanna is a recognized educator, speaker and consultant in several related areas of software engineering.  Dr. Hanna brings over 20 years of experience with building and maintaining software systems.  As a consultant, he helped many organizations define and improve their software processes using disciplined software engineering approaches.  As an associate professor at the University of St. Thomas, he teaches graduate courses on several software engineering topics with emphasis on practical software quality techniques.  His distinguished seminars on various topics have been highly rated by software professionals.

Top of Page Tutorials: Series H


Tutorial #H3 (Thursday 8:30 - 4:30 p.m.)

H3: Principles of Software Test Automation (Basic) (CSTP, #6)

Jamie Mitchell

This tutorial counts as one day of training towards the Certified Software Test Professional requirements.

Principles of Software Automation

  • Why do we test?
  • Why do we automate?
  • Strategic investment
  • Unattended running
  • Erroneous automation assumptions
  • Common automation mistakes
  • Automation requirements
  • Key automation success Factors
  • Philosophy of automation
  • Testability
  • Tools for QA
  • Specifics of R/P automation tools
    • As programming language
    • Recording system
    • Playback
    • GUI ID
    • Accessing GUI objects
    • Logical naming
    • Physical naming
    • Properties
    • Context sensitive
    • Low level
    • Verification
    • High level access
    • Low level access
  • Bad Testing Using Tools
  • Test by eye
  • Tool selection
  • Models
    • Manual test model
    • R/P model
    • Event driven model
    • Changing state model

Abstract functionality

Jamie L. Mitchell is highly skilled with the implementation of software test automation tools from the major vendors and developed a supporting infrastructure to significantly increase the flexibility, ease of use and efficiency of the tools. Jamie was awarded the Master of Computer Science Degree from Lehigh University, is a QAI Certified Software Test Engineer, an instructor and board member for IIST, and a contributing editor for the Journal of Software Testing Professionals.

Top of Page Tutorials: Series H


Tutorial #H4 (Thursday 8:30 - 4:30 p.m.)

H4: Software Inspections and Reviews for QA Professionals
        (Basic) (CSTP, #7)

Dr. Rebecca Staton-Reinstein

This tutorial counts as one day of training towards the Certified Software Test Professional requirements.

This course will examine the different elements that make an effective inspection process and help you establish a process which is customized for your organization. This course is a must for all software persons involved in the software development and maintenance process including managers of all levels. You will learn what the real benefits of inspections are, how to achieve the most value of your inspection effort, the different factors affecting the inspection process, the different forms of inspection and when to use each of them, how to establish different process variations to fit different environments, how to effectively monitor your inspection process to improve its effectiveness, and most importantly, learn from instructors real experiences with inspections.

Dr. Staton-Reinstein has had a long and successful career as an IT professional and organizational leader. She established the Quality Assurance function in three different companies. Her results led to her appointment as a corporate officer to implement total quality management. Her articles on building quality software appear regularly. She works with companies who want to improve their software and their IT management.

Top of Page Tutorials: Series H


Tutorial #H5 (Thursday 8:30 - 4:30 p.m.)

H5: Testing Web and eBusiness Applications: Advanced Techniques
                (Advanced) (CSTP, Elective)

Ross Collard

This tutorial counts as one day of training towards the Certified Software Test Professional requirements.

Going beyond the basics, this session addresses some important questions regarding Web application quality, such as how to check its compatibility, performance, scalability, robustness, usability and operation effectiveness.

Tutorial Objectives

Attendees will learn the following

  • How to Test Portability and Compatibility
  • How to Test Performance and Load
  • How to Test Robustness
  • How to Test Usability
  • How to Test the Integration of Internet Front-Ends with Legacy Systems
  • How to Test Data Base Integrity
  • How to Check the Security Controls

Tutorial Outline 

Portability, Compatibility and Configuration Testing

   Browser, Operating System and Data Base Compatibility
   Hardware and Network Compatibility
   Checking Compliance with Standards
   Middleware 

Performance and Load Testing

   Determining What to Measure
   Developing the Benchmarks (Test Workloads)
   Load and Stress Testing
   Scalability Testing
   Duration or Endurance Testing
   Measuring Performance
   Interpreting the Results
   Performance Test Checklist 

Robustness Testing

   Testing for 24x7 Availability
   Identifying Hazards and Threats
   Error Detection & Recovery Testing
   Simulating Threats in the Test Environment
   Testing Degraded Modes of Operation
   “Rainy Day” Checklist for Robustness Testing 

Usability and Interaction Testing

   Demographics of the Population of Visitors
   What Makes a Web Site Usable
   Testing for Web Usability
   The System Usability Scale
   Design Suggestions for Usability
   International Visitors 

Maintainability

   What makes an Application Maintainable
   Reviewing and Evaluating Maintainability 

Integration Testing

   Testing Components and Component Integration
    API and Middleware Testing
    Testing System Interfaces
    Testing the Integration of Front-Ends with Legacy Systems 

Data Base Testing

   Data Base Testing Approach
    Data Integrity Testing
    Data Sampling
    Data Base Test Case Checklist
    Data Base Back-up & Recovery Testing
    Query (SQL) Testing 

Security Controls Testing

   Sources and Types of Security Threats
    Prevention, Detection, Mitigation and Recovery Methods
    Reviewing and Evaluating the Security Controls
    Security & Controls Testing Checklist
    Virus Controls 

Monitoring Service Levels in Live Operation

   Measuring and Response Time, Throughput and Availability
    Monitoring Resource Utilization
    Evaluating User Satisfaction 

Ross Collard is a software testing consultant.   His clients have included: Amazon.com, American Express, Anheuser-Busch, Banamex, Bank of America, Baxter Healthcare, Bechtel, Blue Cross/Blue Shield, Boeing, British Airways, the CIA, Ciba Geigy, Cisco, Citibank, Dell, EDS, Exxon, General Electric,  Goldman Sachs, the Federal Reserve Bank, Ford, Fijitsu, Hewlett-Packard, Intel, Johnson & Johnson, JP Morgan, Lucent, McGraw Hill, Merck, Microsoft, Motorola, NASA, Nortel, Oracle, Procter & Gamble, Prudential, IBM, the U.S. Air Force, Worldcom and Yahoo.  Ross has taught software testing for Harvard and U.C. Berkeley.

Top of Page Tutorials: Series H


Tutorial #H6 (Thursday 8:30 - 4:30 p.m.)

H6: Effective Estimating and Planning Techniques Workshop (Intermediate)

Bob Galen 

This tutorial counts as one day of training towards the Certified Software Test Professional requirements.

Workshop Objective                                                                      

The project and cultural dynamics of planning and estimating are one of the greater challenges facing technologists today. There is ever increasing pressure to “get things done”, so there is little “time” for estimating or planning. All too often, business derived dates or unrealistic dates drive projects. In conjunction with this, teams lack solid estimating and planning skills, usually resorting to “quick best guesses”, then compensating for poor estimates and plans with extremely hard work with a low probability of success. This workshop is intended to provide a review of five collaborative estimating and planning techniques that will enhance and improve your abilities to effectively estimate and plan your projects. Almost half the workshop is spent in exercises learning to apply the techniques.

Workshop Overview

The workshop is a survey or overview of five contrasting estimation and planning techniques:

 

q       PSP - PROBE Method & TSP - Watts Humphrey

o       PSP – PROBE is focused on individual work estimation from previous performance historical data (proxies for different types of work, estimate & actual data)

o       TSP – focuses more on project management, development lifecycle and team dynamics (very detailed role definitions - overlaps more with XP and SPSG planning)

q       Wideband Delphi - Barry Boehm

o       Small scope (~ 50 tasks) collaborative, team based brainstorming for tasks, effort, sequencing / scheduling

o       By-products include artifacts for risks and assumptions

o       Using "area experts" for each estimating exercise

q       Notes on a Wall (NoaW) - Dwayne Phillips

o       An effective brainstorming technique for larger scale and more intensive planning sessions

o       A logical "extension" to Wideband Delphi – RAD planning

o       Also examines task sequencing, assumptions, risks and other project dependencies

q       Extreme (XP) Planning - Kent Beck

o       Extremely (pun intended) lightweight planning

o       Customer integrated in the planning and decision making process

o       Iteration (2-3) week effort planning with on-the-fly adjustments

q       Software Project Survival Guide - Steve McConnell

o       Mostly focused on the lifecycle dynamics of a project and planning

o       Very "checklist" and best practice oriented

o       Emphasizes a phased deliverable approach 

We will present an in-depth overview of each of the techniques with ongoing contrast between them. We will also examine strengths and weaknesses of each. At the end of each technique, we will explore it in more practical detail with a breakout session.  

At the end of the workshop, we will explore three in depth project scenarios - looking to apply lessons learned from each of the techniques to estimate and plan each scenario. This is the real key to the workshop - effectively learning to apply portions of the estimating and planning techniques to real projects.

Keep in mind that all of these techniques are relatively "soft" in that no model based estimation tools are used. Instead, they mostly focus on "rules of thumb" and collaborative, team based approaches to estimation and planning. Also realize that, while the techniques and the presentation focus more on software projects, the techniques themselves are completely general purpose. 

Who Will Benefit?

Attendees from project management, software engineering, quality and testing, system engineering and functional management will benefit by learning a set of estimation and planning tools that can be applied to their projects. You should have at least 3 years of experience contributing within technology product development teams. 

You will gain:

·        An in-depth overview, with practice, of the presented techniques

·        Skills for how to use collaborative, team based techniques to improve your work estimating

·        Insight into the nature of XP planning - how lightweight the method truly is

·        Not only estimating, but how to use collaboration, team based techniques for planning

Finally, skills in applying the right parts of the techniques to a variety of project situations.

Biography:

Bob Galen is currently operating RGalen Consulting Group, L.L.C in RTP, NC. He has held director, manager and contributor level positions in both software development and software QA organizations. He has over 20 years of experience working in the financial trading system, mail processing equipment, medical diagnostics system, computer system, telecommunications and network analysis equipment domains.  

He has a broad background that spans real-time embedded to client/server systems architecture and development in a wide variety of languages and technologies. Since the early 1990’s, he has been involved in successfully leading process improvement initiatives. Areas of particular interest include, requirement analysis and management, project management, software metrics, and software development team dynamics. 

Mr. Galen is an active member of ACM, IEEE/CS and PMI. He is also active in the RTP SPIN group - associated with the SEI.

Top of Page Tutorials: Series H