CONTENTS Title Page Copyright Page Preface 1 Introduction to HSM 1.1 Storage Management in the OpenVMS Environment 1.1.1 Data Categories 1.1.2 Device Capacity, Cost, and Performance 1.1.3 Storage Management Planning 1.2 Storage Management with HSM 1.2.1 File Headers and Location 1.2.2 Controlling File Movement 1.3 HSM Storage Management Concepts 1.3.1 Shelf 1.3.2 Archive Class 1.3.3 HSM Policies 1.4 The Shelving Process 1.4.1 Starting the Shelving Process 1.4.2 File Selection for Explicit Shelving 1.4.3 File Selection for Implicit Shelving 1.4.4 Modifying File Attributes of a Shelved File 1.5 The Unshelving Process 1.5.1 Starting the Unshelving Process 1.5.2 Process Default Unshelving Action 1.5.3 The Results of Unshelving a File 1.5.4 Handling Duplicate Requests to Unshelve a File 1.6 The Preshelving Process 1.7 File Headers and Access Security 1.8 HSM Cache 1.8.1 HSM Operations with Cache 1.8.2 Cache in the Shelving and Preshelving Processes 1.8.3 Unshelving from Cache 1.8.4 Exceeding Cache Capacity 1.8.5 Flushing Cache 1.9 The HSM Shelving Catalog 1.10 HSM Software Modes 1.10.1 HSM Basic Mode Functions 1.10.2 HSM Plus Mode Functions 1.10.3 HSM Mode Comparison Table 1.11 Media Types for HSM Basic Mode 1.12 Device Support 1.13 Online Devices Not Supported for HSM Operations 1.14 HSM Support for Remote Operations 2 Installing HSM Software 2.1 Before Installing HSM 2.1.1 Check Operating System Requirements 2.1.2 Confirm Prerequisite Software for HSM Plus Mode 2.1.3 License Registration 2.1.3.1 Using the Online Capacity License 2.1.3.2 Registering Your HSM License 2.1.4 Installing DECthreads Images 2.1.5 Upgrading from Previous HSM Versions 2.2 Installation Procedure Requirements 2.2.1 Required Privileges 2.2.2 Required Disk Space 2.2.3 System Parameters 2.2.4 User Account Quotas 2.2.5 VMSINSTAL Requirements 2.2.6 Backing Up Your System Disk 2.3 Installing the HSM Software 2.3.1 The Installation Procedure 2.3.2 Error Recovery 2.4 After Installing HSM Software 2.4.1 Editing the System Startup and Shutdown Files 2.4.2 Creating an HSM Catalog 2.4.3 Backing Up the Catalog 2.4.4 Installing Device Drivers 2.4.4.1 Using Magazine Loaders Connected to a Native SCSI Bus 2.4.4.2 Using Devices Connected to an HS x Controller 2.5 VMScluster System Considerations 2.6 HSM Configuration Requirements 2.7 Installation Verification Procedure 3 Understanding HSM Concepts 3.1 The HSM Environment 3.2 The HSM Facility 3.2.1 HSM Mode 3.2.2 HSM Operations 3.2.3 Shelf Servers 3.2.4 Event Logging 3.3 The Shelf 3.3.1 Using Multiple Shelf Copies 3.3.2 Defining Shelf Copies 3.3.2.1 Archive Lists and Restore Archive Lists 3.3.2.2 Primary and Secondary Archive Classes 3.3.2.3 Multiple Shelf Copies 3.3.3 Shelving Operations 3.4 HSM Basic Mode Archive Class 3.5 HSM Plus Mode Archive Class 3.6 Device 3.6.1 Sharing and Dedicating Devices 3.6.2 Device Operations 3.6.3 Devices and Archive Classes 3.6.4 Magazine Loaders for HSM Basic Mode 3.6.5 Automated Loaders and HSM Plus Mode 3.6.6 Compatible Media for HSM Basic Mode 3.7 Volume 3.7.1 Shelf 3.7.2 Shelving Operations 3.7.3 Volume Policy 3.7.4 High Water Mark 3.7.5 Files Excluded from Shelving 3.8 Cache 3.8.1 Advantages and Disadvantages of Using a Cache 3.8.2 Cache Flushing 3.8.3 Cache Attributes 3.8.3.1 Timing of Shelf Copies 3.8.3.2 Cache Block Size 3.8.3.3 High Water Mark 3.8.3.4 Cache Flush Interval 3.8.3.5 Cache Flush Delay 3.8.3.6 Delete File Action 3.8.4 Optimizing Cache Usage 3.8.5 Using Magneto-Optical Devices 3.9 Policy 3.9.1 HSM Policy Options 3.9.2 Trigger Events 3.9.2.1 Scheduled Trigger 3.9.2.2 User Disk Quota Exceeded Trigger 3.9.2.3 High Water Mark Trigger 3.9.2.4 Volume Full Trigger 3.9.3 File Selection Criteria 3.9.4 Policy Goals 3.9.5 Make Space Requests and Policy 3.10 Schedule 3.10.1 Online Volumes 3.10.2 Execution Timing and Interval 3.10.3 Server Node 3.11 HSM System Files and Logical Names 3.11.1 HSM$CATALOG 3.11.2 HSM$MANAGER 3.11.3 HSM$LOG 4 Getting Started with HSM Basic Mode 4.1 How to Get HSM Basic Mode Running Quickly 4.2 Sample HSM Basic Mode Configuration 4.3 Getting HSM Basic Mode Up and Running 4.3.1 HSM's Default Configuration 4.3.1.1 The Default Facility 4.3.1.2 The Default Shelf 4.3.1.3 The Default Device 4.3.1.4 The Default Volume 4.3.1.5 The Default Policies 4.3.2 Running HSM Basic Mode with the Default Configuration 4.3.3 Verifying the Facility Definition 4.3.4 Defining Archive Classes for Use 4.3.5 Selecting Archive Classes for the Default Shelf 4.3.6 Defining Devices for the Archive Classes 4.3.7 Initializing the First Tape Volume for Each Archive Class 4.3.8 Using the Default Policy Definitions 4.4 Additional Configuration Items 4.4.1 Authorizing Shelf Servers 4.4.2 Working with a Cache 4.4.3 Running Default Policies 4.4.4 Template Policy Definitions 4.4.4.1 Using a Template Policy Definition 4.4.4.2 Changing Default Policy Definitions 4.4.4.3 Deleting Default Policy Definitions 5 Getting Started with HSM Plus Mode 5.1 How HSM Plus Mode and MDMS Work Together 5.1.1 How MDMS Supports HSM 5.1.2 MDMS Commands for HSM Plus Mode Use 5.2 How to Get Up and Running in HSM Plus Mode 5.3 MDMS Configuration Tasks Required to Support HSM Plus Mode 5.3.1 Defining Media Triplets 5.3.2 Adding Volumes to MDMS Database for HSM to Use 5.3.3 Authorizing HSM Access to Volumes 5.3.4 Configuring Magazines 5.3.5 Configuring Special Jukebox Information 5.4 Using HSM Plus Mode with HSM's Default Configuration 5.4.1 Defining Archive Classes 5.4.2 Associating Archive Classes with a Shelf 5.4.3 Defining Devices 5.4.4 Working with Remote Devices in HSM Plus Mode 5.5 HSM Plus Configuration Examples 5.5.1 Sample TA90 Configuration 5.5.2 Sample TZ877 Configuration 5.5.3 Sample Local TL820 Configuration 5.5.4 Sample Remote TL820 Configuration 5.5.4.1 Definitions on Client Node 5.5.4.2 Definitions on Remote Node 6 Customizing the HSM Environment 6.1 Configuring a Customized HSM Environment 6.1.1 Customizing the HSM Facility 6.1.2 Creating Shelf Definitions 6.1.3 Enabling and Disabling a Shelf Definition 6.1.4 Modifying Archive Classes 6.1.5 Creating Device Definitions 6.1.6 Modifying Device Definitions 6.1.7 Enabling and Disabling a Volume Definition 6.1.8 Working with Caches 6.1.9 Enabling and Disabling a Policy Definition 6.1.10 Scheduling Policy Executions 6.2 Implementing Shelving Policies 6.2.1 Determining the Disk Volumes 6.2.2 Creating Volume Definitions 6.2.3 Determining File Selection Criteria 6.2.4 Creating Policy Definitions 6.2.5 Using Expiration Dates 6.2.6 Creating Schedule Definitions 6.2.7 Enabling Preventive Policy 7 Using HSM 7.1 What the User Sees in an HSM Environment 7.1.1 Identifying Shelved Data using the DIRECTORY Command 7.1.1.1 DIRECTORY/FULL 7.1.1.2 DIRECTORY/SHELVED_STATE 7.1.1.3 DIRECTORY/SIZE 7.1.2 Accessing Files 7.1.3 Decreasing Volume Full and Disk Quota Exceeded Errors 7.1.4 Viewing Messages 7.2 Controlling Shelving and Unshelving 7.2.1 Automatic Shelving Operations 7.2.2 User-Controlled Shelving Operations 7.2.3 Unshelving Files 7.3 Finding Lost Data 7.4 Working with Remote Files 7.5 Resolving Duplicate Operations on a File 7.6 Controlling Other HSM Functions 8 Managing the HSM Environment 8.1 Protecting System Files from Shelving 8.1.1 Critical HSM Product Files 8.1.2 OpenVMS System Files and System Disks 8.1.3 Files Not Shelved 8.2 Ensuring Data Safety with HSM 8.2.1 Access Control Lists for Shelved Files 8.2.2 Handling Contiguous and Placed Files 8.3 Using Backup Strategies with HSM 8.3.1 Backing up Critical HSM Files 8.3.1.1 Defining a Backup Strategy 8.3.1.2 Using VMSBACKUP to Save the Files 8.3.1.3 Maintaining a Manual Copy of the Files 8.3.2 Backing Up Shelved Data 8.3.2.1 Considerations for OpenVMS BACKUP and Shelving 8.3.2.2 Using Multiple HSM Archive Classes for Backup 8.3.2.3 Storing HSM Archive Classes Offsite 8.3.3 Backing Up Data Stored in an Online Cache 8.4 Finding Lost User Data 8.5 Special Considerations for Recovering HSM Data 8.5.1 Recovering Data Shelved Through HSM 8.5.2 Recovering Critical HSM Files 8.5.3 Recovering Boot-Up Files 8.5.4 Reshelving an Archive Class 8.6 Maintaining Shelving Policies 8.6.1 The HSM Policy Model 8.6.1.1 Concepts of HSM Policy 8.6.1.2 Policy Governs the Shelving Process 8.6.1.3 The Balance to Achieve When Implementing Policy 8.6.2 HSM Policy Situations and Resolutions 8.6.2.1 Situation: Volume Occupancy Full Event 8.6.2.2 Situation: Shelving Goal Not Reached 8.6.2.3 Situation: Frequent Reactive Shelving Requests 8.6.2.4 Situation: Application and User Performance Impeded 8.6.3 Ranking Policy Execution 8.7 Event Logging 8.7.1 Accessing the Logs 8.7.2 Shelf Handler Log Entries 8.8 Activity Logging 8.9 Dismounting Disks 8.10 Determining Cache Usage 8.11 Maintaining File Headers 8.11.1 Determining File Header Limit 8.11.2 Specifying a Volume's File Headers 8.11.3 Extending the Index File 8.11.4 Maintaining the Number of File Headers 8.12 Converting from Basic Mode to Plus Mode 8.12.1 Shutting Down the Shelf Handler 8.12.2 Disabling the Shelving Facility 8.12.3 Entering Information for MDMS 8.12.4 Changing from Basic Mode to Plus Mode 8.12.5 Restarting the Shelf Handler 8.12.6 Using the Same Archive Classes 8.12.7 Enabling the Facility 9 Operator Activities in the HSM Environment 9.1 Enabling the Operator Interface 9.2 Loading and Unloading Single Tapes for HSM Basic Mode 9.2.1 Load Volume, No Reply Needed 9.2.2 Load Volume 9.2.3 Reinitialize Volume 9.2.4 Volume Initialization Confirmation 9.2.5 Unload Label Request 9.3 Responding to BACKUP Requests for HSM Basic Mode 9.4 Working with Magazine Loaders for HSM Basic Mode 9.4.1 Load Magazine 9.4.2 Illegal Magazine 9.4.3 Unload Magazine 9.5 Working with Automated Loaders for HSM Plus Mode 9.5.1 Providing the Correct Magazine 9.5.2 Providing the Correct Volume for a TL820 9.6 Other MDMS Messages 9.7 Informational Operator Messages 10 Solving Problems with HSM 10.1 Introduction to Troubleshooting 10.2 Troubleshooting Tools 10.2.1 Startup Logs 10.2.2 Event Logs 10.2.3 Activity Log 10.2.4 SMU LOCATE 10.2.5 UNSHELVE/OVERRIDE 10.2.6 SMU RANK 10.2.7 SMU SET and SHOW Commands 10.2.8 MDMS Tools for HSM Plus Mode 10.3 Installation Problems 10.4 HSM Startup Problems 10.4.1 SMU Does Not Run 10.4.2 The Shelf Handler Does Not Start Up 10.4.3 Policy Execution Process Does Not Start Up 10.4.4 HSM Does Not Shut Down 10.4.5 Shelving and SMU Commands Do Not Work 10.5 Mass Shelving 10.6 Shelving on System Disks 10.7 HSM Plus Mode (MDMS) Problems 10.8 HSM VMScluster Problems 10.9 Online Disk Problems 10.10 Cache Problems 10.11 Magneto-Optical Device Problems 10.12 Offline Device Problems 10.13 Magazine and Robotic Loader Problems 10.14 Shelving Problems 10.15 Unshelving Problems 10.16 Policy Problems 10.17 HSM System File Problems 10.18 HSM Limitations 10.18.1 OpenVMS Limit on File Headers 10.18.2 Attempting to Cancel Execution of a Shelved File 10.18.3 Automatic Unshelving of Files across a Network 10.18.4 Opening and Deleting RMS Indexed Files 11 The HSM Command Environment 11.1 DCL Commands DIRECTORY PRESHELVE SET FILE SET PROCESS SHELVE UNSHELVE 11.2 The Shelf Management Utility 11.3 Shelf Management Utility Commands SMU CHECKPOINT SMU EXIT SMU HELP SMU LOCATE SMU RANK SMU SET ARCHIVE SMU SET CACHE SMU SET DEVICE SMU SET FACILITY SMU SET POLICY SMU SET SCHEDULE SMU SET SHELF SMU SET VOLUME SMU SHOW ARCHIVE SMU SHOW CACHE SMU SHOW DEVICE SMU SHOW FACILITY SMU SHOW POLICY SMU SHOW REQUESTS SMU SHOW SCHEDULE SMU SHOW SHELF SMU SHOW VERSION SMU SHOW VOLUME SMU SHUTDOWN SMU SPAWN SMU STARTUP A HSM Sample Basic Mode Installation B HSM Plus Mode Sample Installation C HSM Basic Mode Sample Configuration C.1 The Customer Environment C.1.1 Hardware Configuration C.1.2 Data Characteristics C.1.3 Backup Strategy C.2 Configuring the Facility C.3 Configuring the Shelves C.4 Configuring the Devices C.5 Configuring the Policies C.6 Setting Volume Retention C.7 Scheduling the Policies C.8 Configuring the Volumes C.9 Configuring the Cache C.10 Using Tape Drives C.11 Using Magneto-Optical Devices D HSM Status and Error Messages D.1 OpenVMS Messages D.2 Shelf Handler Messages D.3 Explicit Shelf Request Messages D.4 Shelf Management Utility Messages HSM Glossary FIGURES 1-1 Storage Management Hierarchy 3-1 HSM Environment 3-2 Volume and Archive Class Relationship 3-3 Archive Classes, Media Types, and Devices 3-4 HSM Policy Operations 8-1 HSM Policy Model 8-2 Shelving to Reactive Policy 8-3 Volume Occupancy Full Event 8-4 Shelving Goal Not Reached 8-5 Frequent Reactive Shelving Requests 8-6 Application and User Performance Impeded TABLES 1-1 File Activity and Data Storage 1-2 Process for Selecting Files According to Policy 1-3 Process for Unshelving a File 1-4 Process for Shelving and Preshelving with Cache 1-5 HSM Basic and Plus Functionality 1-6 Media Type to Device Map 1-7 SCSI Devices Supported 1-8 DSA Devices Supported 1-9 Footnotes to Device Tables 2-1 How to Register Your HSM License 2-2 Disk Space Requirements 2-3 How to Install the HSM Software 3-1 HSM Basic Mode Archive Class Identifier/Label Reference 3-2 Compatible Media Types 4-1 Archive Class Identifier/Label Reference for HSM Basic Mode 4-2 Procedure for Setting Volume Retention Dates 4-3 Supplied Default Policy Definitions 4-4 Sample Procedure for Using a Template Definition 5-1 MDMS Commands for HSM Plus Mode 6-1 Procedure for Setting File Expiration Dates 7-1 Typical File Access Time by Storage Device 7-2 File Selection 7-3 How HSM Resolves Conflicting Requests 8-1 Critical HSM Files 8-2 HSM Policy Model Concept Definitions 8-3 Process for Shelving to Reactive Policy 8-4 HSM Event Logging 8-5 Canceling Requests 10-1 SMU Does Not Run 10-2 The Shelf Handler Does Not Start Up 10-3 Policy Execution Process Does Not Start Up 10-4 HSM Does Not Shut Down 10-5 Accidentally Starting Mass Shelving 10-6 Shelving on System Disks 10-7 MDMS Problems 10-8 HSM VMScluster Problems 10-9 Online Disk Problems 10-10 Cache Problems 10-11 MO Device Problems 10-12 Offline Device Problems 10-13 Loader Problems 10-14 Shelving Problems 10-15 Unshelving Problems 10-16 Policy Problems 11-1 Summary of DCL Commands 11-2 Summary of SMU Commands C-1 Tape Drive Usage