CONTENTS

  Title Page

  Copyright Page

  Preface

  1      Introduction to DEC Test Manager for OpenVMS
    1.1 Overview
    1.2 Entering Commands
      1.2.1      Getting Help
      1.2.2      Canceling Commands
    1.3 Getting Started

  2      Using DEC Test Manager for OpenVMS in a DECwindows Environment
    2.1 Overview
      2.1.1      Getting Help
      2.1.2      Displaying DEC Test Manager for OpenVMS Information in DECwindows
      2.1.3      DEC Test Manager for OpenVMS Command Correlation
    2.2 Sample DECwindows Session
      2.2.1      Creating a Library
      2.2.2      Creating a Test
      2.2.3      Recording a Test
      2.2.4      Creating a Collection
      2.2.5      Executing a Collection
      2.2.6      Displaying Test Results
      2.2.7      Updating a Benchmark File
      2.2.8      Creating a Benchmark Mask
      2.2.9      Removing the Screen Editor

  3      Creating Tests
    3.1 DEC Test Manager for OpenVMS Libraries
      3.1.1      Creating a DEC Test Manager for OpenVMS Library
      3.1.2      Setting a Library
      3.1.3      Displaying DEC Test Manager for OpenVMS Library Information
      3.1.4      DEC Test Manager for OpenVMS History
        3.1.4.1      Adding a Remark to the History
        3.1.4.2      Deleting History Information
    3.2 Test Descriptions
      3.2.1      Creating Test Descriptions
      3.2.2      Displaying Test Descriptions
      3.2.3      Copying Test Descriptions
      3.2.4      Modifying Test Descriptions
      3.2.5      Deleting Test Descriptions
    3.3 Creating Noninteractive Tests
      3.3.1      Writing a Noninteractive Test
      3.3.2      Writing a Template File for a Noninteractive Test
      3.3.3      Creating a Noninteractive Test Description
    3.4 Creating Interactive Tests
      3.4.1      Recording Tests
        3.4.1.1      Record Command Key Sequences
        3.4.1.2      Exiting from a Recording Session
        3.4.1.3      Redefining the Termination Character
        3.4.1.4      Redefining the Command Keysym Key
      3.4.2      Interactive Terminal Recording
      3.4.3      Interactive DECwindows Recording
    3.5 Creating an Input File from a Session File
    3.6 Playing Back an Interactive Test
      3.6.1      Playing an Interactive Terminal Session
      3.6.2      Playing an Interactive DECwindows Session
    3.7 Processing Considerations for Interactive Terminal Tests
      3.7.1      Time-Dependent Applications
      3.7.2      Playing Back Applications in Real Time
      3.7.3      Ctrl/C or Ctrl/Y
      3.7.4      Applications That Accept Unsolicited Input
      3.7.5      Device Type and Terminal Characteristics
      3.7.6      Graphics Mode Commands
      3.7.7      Comparison of Scrolled Screens
    3.8 Processing Considerations for DECwindows Tests
      3.8.1      Playing DECwindows Tests
      3.8.2      Storing DECwindows Benchmark and Result Files
      3.8.3      Environment Initialization

  4      Organizing and Executing Test Collections
    4.1 Creating Collections
    4.2 Executing Collections
      4.2.1      Executing Collections in Batch
      4.2.2      Executing Collections Interactively
      4.2.3      Stopping the Execution of Collections
    4.3 Displaying a Collection Summary
    4.4 Deleting Collections
    4.5 Re-creating Collections
    4.6 Comparing Test Results
    4.7 Recomparing Partially Compared Collections

  5      Reviewing Test Results
    5.1 Review Concepts
      5.1.1      Using Result Descriptions
        5.1.1.1      Output Files
        5.1.1.2      Comparison Status
      5.1.2      Specifying Result Descriptions
    5.2 Examining Test Results
      5.2.1      Using the Review Subsystem
        5.2.1.1      Review Subsystem Overview
        5.2.1.2      Primary and Read-only Reviewers
        5.2.1.3      Canceling Review Subsystem Commands
        5.2.1.4      Locating Test Results in the Review Subsystem
        5.2.1.5      Using the Review Subsystem Keypads
      5.2.2      Displaying Test Results
      5.2.3      Printing Test Results
    5.3 Working with Test Results
      5.3.1      Updating an Existing Benchmark File
      5.3.2      Creating a Benchmark File for a New Test
      5.3.3      Reviewing Partially Run Collections

  6      Tailoring Your Test System
    6.1 Using Prologue and Epilogue Files
      6.1.1      Test Prologue and Epilogue Files
      6.1.2      Collection Prologues and Epilogues
    6.2 Grouping Tests
      6.2.1      Organizing Tests into Groups
      6.2.2      Displaying a Group Structure
      6.2.3      Removing Tests and Sub-groups from Groups
      6.2.4      Deleting Groups
    6.3 Using Variables
      6.3.1      Modifying and Deleting Variables
      6.3.2      Overriding Variable Default Values
      6.3.3      Using Variables Defined by DEC Test Manager for OpenVMS
        6.3.3.1      DTM$COLLECTION_NAME Global Symbol
        6.3.3.2      DTM$TEST_NAME Local Symbol
        6.3.3.3      DTM$RESULT Logical Name
      6.3.4      Using User-Defined Variables to Control DEC Test Manager for OpenVMS
        6.3.4.1      DTM$DECW$DISPLAY Logical Variable
        6.3.4.2      DTM$DELAY_TIMEOUT Logical Variable
        6.3.4.3      DTM$OMIT_PRINTABLE_SCREENS Logical Variable
        6.3.4.4      DTM$DATE_FILTER_MIN_YEAR Logical Variable
        6.3.4.5      DTM$DATE_FILTER_MAX_YEAR Logical Variable
        6.3.4.6      DTM$DATE_FILTER_STRING Logical Variable
        6.3.4.7      DTM$DATE_MASK_MIN_YEAR Logical Variable
        6.3.4.8      DTM$DATE_MASK_MAX_YEAR Logical Variable
    6.4 Using Filters
      6.4.1      Associating and Disabling Test Filters
      6.4.2      Applying File Filters
      6.4.3      Using Masks
    6.5 Defining Keypad Keys
    6.6 Using Command Files
      6.6.1      Creating and Invoking a Command File
      6.6.2      Creating a DEC Test Manager for OpenVMS Initialization Command File
    6.7 Spawning or Attaching to Another Process
    6.8 Gathering Test Coverage Data

  7      Maintaining a DEC Test Manager for OpenVMS Library
    7.1 Correcting an Invalid DEC Test Manager for OpenVMS Library
    7.2 Storing Files Outside a DEC Test Manager for OpenVMS Library
      7.2.1      Setting Benchmark and Template Directories
      7.2.2      Storing Files in CMS Libraries
    7.3 Security Features
      7.3.1      Assigning UIC Protection
      7.3.2      Assigning ACL Protection
        7.3.2.1      Using ACLs on Library Directories
        7.3.2.2      Using ACLs on Library Files

  8      Working with Terminal Session Files
    8.1 Terminal Session Files
      8.1.1      Sample Session File
      8.1.2      Terminal Session File Structure
        8.1.2.1      Record Structure of Session Files
        8.1.2.2      Modifying Session Files Directly
    8.2 Input Files
      8.2.1      Sample Input File
      8.2.2      Special Strings
        8.2.2.1      Types of Special Strings Recognized by DEC Test Manager for OpenVMS
        8.2.2.2      Using Special Strings in Input Files
    8.3 Creating Input Files
      8.3.1      Extracting an Input File from a Session File
      8.3.2      Creating an Input File with a Text Editor
    8.4 Recording a Session File from an Input File
      8.4.1      Using the /INPUT Qualifier
      8.4.2      Using the INSERT Recording Function
      8.4.3      Terminal Characteristics
      8.4.4      Type-Ahead
    8.5 Translation Tables

  9      Working with DECwindows Session Files
    9.1 DECwindows Session File Format
      9.1.1      DECwindows Session File Header Information
      9.1.2      DECwindows Session File Records
      9.1.3      Keyboard Commands to Control Session File Recording
    9.2 Synchronizing Playback

  10     DEC Test Manager for OpenVMS Callable Interface
    10.1 Calling Sequence for DTM$DTM
      10.1.1     Command Line (command_line)
      10.1.2     Message Routine (msg_routine)
      10.1.3     Prompt Routine (prompt_routine)
      10.1.4     Confirmation Routine (confirm_routine)
      10.1.5     Output Routine (output_routine)
      10.1.6     Output Width (width)
      10.1.7     Initialization Flag (init_flag)
    10.2 Rules for Writing DEC Test Manager for OpenVMS Callback Routines
    10.3 Handling Error Conditions
    10.4 Writing an Error Message Handler
    10.5 Linking with the DEC Test Manager for OpenVMS Image

  Glossary