CONTENTS Title Page Copyright Page Preface 1 Introduction to VAXcluster Systems 1.1 Shared Resources 1.1.1 Disk and Tape Storage 1.1.2 Batch and Print Job Processing 1.2 Interconnect Devices 1.3 Software Components 1.4 Configuration Planning 2 VAXcluster Interconnect Configurations 2.1 Configuration Types 2.2 CI-Based VAXcluster Systems 2.3 Local Area VAXcluster Systems 2.4 Mixed-Interconnect VAXcluster Systems 2.5 DSSI-Based VAXcluster Configurations 2.6 FDDI VAXcluster Systems 2.6.1 Multilobe FDDI VAXcluster System 2.6.2 Network Configurations Using FDDI as VAXcluster Interconnect 2.7 Configuring Multiple CI Adapters 2.8 Configuring Multiple DSSI Adapters 2.9 Configuring Multiple LAN Adapters 2.9.1 VAXcluster with Two LAN Segments 2.9.2 VAXcluster with Three LAN Segments 2.9.3 Guidelines to Allow for LAN Bridge Failover 2.9.4 Adjusting LRPSIZE for FDDI Configurations 2.10 Security for Local Area and Mixed-Interconnect VAXcluster Systems 3 VAXcluster Integrity and Availability Features 3.1 Connection Management 3.1.1 The Quorum Scheme 3.1.2 Quorum Disk 3.1.3 State Transitions 3.2 VMS Volume Shadowing 3.2.1 Volume Shadowing Concepts 3.2.2 Distributing Shadow Sets Across VMS Configurations 4 Preparing the Cluster Operating Environment 4.1 Directory Stucture on a Common System Disk 4.2 Installing the VMS Operating System in the VAXcluster Environment 4.3 Configuring and Starting the DECnet-VAX Network 4.3.1 Copying Remote Node Databases 4.3.2 Enabling VAXcluster Alias Operations 4.4 Coordinating Startup Command Procedures 4.4.1 Building Startup Procedures for a Common-Environment Cluster 4.4.1.1 Procedures for Existing Computers 4.4.1.2 Procedures for Newly Installed Computers 4.4.2 Building Startup Procedures for a Multiple-Environment Cluster 4.5 Coordinating System Files for a Common-Environment Cluster 4.5.1 Coordinating User Accounts 4.5.2 Preparing the Rights Database 4.5.3 Preparing the MAIL Database 4.5.4 Coordinating Shared System Files in Clusters with Multiple Common System Disks 5 Setting Up and Managing Cluster Disks and Tapes 5.1 Cluster-Accessible Disk and Tape Devices 5.1.1 HSC Disks and Tapes 5.1.2 Served Disks and Tapes 5.1.2.1 MSCP and TMSCP Server Functions 5.1.2.2 MSCP Load Sharing 5.1.3 Dual-Pathed Disks and Tapes 5.1.3.1 Dual-Ported HSC Disks and Tapes 5.1.3.2 Dual-Pathed DSA Disks and Tapes on Local UDA/KDA/KDB Controllers 5.1.3.3 Preferred Path Specification 5.1.3.4 DSSI-Connected ISEs 5.1.3.5 Dual-Ported MASSBUS Disks 5.2 Cluster Device-Naming Conventions 5.2.1 Rules for Specifying Allocation Class Values 5.2.2 Sample Configurations with Named Devices 5.3 Shared Disks 5.4 Configuring Cluster Disks 5.5 Rebuilding Cluster Disks 6 Setting Up and Managing Cluster Queues 6.1 Clusterwide Queues 6.2 Cluster Printer Queues 6.2.1 Setting Up Printer Queues 6.2.2 Setting Up Clusterwide Generic Printer Queues 6.3 Cluster Batch Queues 6.3.1 Setting Up Execution Batch Queues 6.3.2 Setting Up Clusterwide Generic Batch Queues 6.4 Using a Common Command Procedure to Set Up Cluster Queues 6.5 Starting Local Batch Queues 7 Building and Maintaining the Cluster 7.1 CLUSTER_CONFIG.COM Functions 7.2 Determining Locations and Sizes for Satellite Page and Swap Files 7.3 Selecting MOP and Disk Servers 7.4 Determining Allocation Class Values in Mixed-Interconnect Clusters 7.5 Configuring the Cluster 7.5.1 Adding a Computer to the Cluster 7.5.1.1 Updating Network Data After Adding a Satellite 7.5.1.2 Restoring a Satellite's Network Data 7.5.1.3 Controlling Clusterwide Broadcast Messages on Satellites and Boot Servers 7.5.2 Removing a Computer from the Cluster 7.5.3 Changing a Computer's Characteristics 7.5.4 Changing the Cluster Configuration Type 7.5.4.1 Changing an Existing CI-Only Cluster to a Mixed-Interconnect Configuration 7.5.4.2 Changing an Existing Local Area Cluster to a Mixed-Interconnect Configuration 7.5.5 Converting a Standalone Computer to a VAXcluster Computer 7.5.6 Creating a Duplicate System Disk 7.6 Reconfiguring the Cluster After a Major Change 7.6.1 Updating MODPARAMS.DAT Files to Adjust Cluster Quorum 7.6.2 Shutting Down the Cluster 7.6.3 Changing Allocation Class Values on HSC Subsystems 7.6.4 Changing Allocation Class Values on DSSI Subsystems 7.6.5 Rebooting the Cluster 7.7 Maintaining the Cluster 7.7.1 Running AUTOGEN with the FEEDBACK Option 7.7.2 Recording Configuration Data 7.7.3 Monitoring LAN Activity in Local Area and Mixed-Interconnect Clusters 7.7.4 Performing VAXcluster Network Failure Analysis 7.7.5 Restoring Cluster Quorum After an Unexpected Computer Failure 7.7.6 Selecting Cluster Shutdown Options 7.7.6.1 The REMOVE_NODE Option 7.7.6.2 The CLUSTER_SHUTDOWN Option 7.7.6.3 The REBOOT_CHECK Option 7.7.6.4 The SAVE_FEEDBACK Option 7.7.7 Rebooting a Satellite with an Operating System on a Local Disk 7.7.8 Performing Security Functions in Local Area and Mixed-Interconnect Clusters 7.7.8.1 Maintaining Cluster Security Data 7.7.8.2 Controlling Conversational Bootstrap Operations for Satellites 7.8 Guidelines for Configuring Large Clusters 7.8.1 Local Area VAXcluster Satellite Booting 7.8.1.1 Alternate Adapter Booting 7.8.1.2 Changing the LAN Address in the DECnet Database to Allow a Cluster Satellite to Boot with Any Adapter 7.8.1.3 Displaying Connection Messages During Cluster Satellite Booting 7.8.1.4 Configuring MOP Service on DECnet Routers 7.8.2 Configuring Disk Server LAN Adapters and Memory 7.8.3 Configuring System Disks 7.8.3.1 Concurrent User Activity 7.8.3.2 Concurrent Booting Activity 7.8.3.3 Boot Time Costs 7.8.3.4 Moving High-Activity Files off System Disks 7.8.3.5 Controlling Dump File Size and Creation 7.8.3.6 Sharing Dump Files 7.8.4 Adding Computers to an Existing Cluster 7.8.4.1 Running AUTOGEN with FEEDBACK for Initial Configuration 7.8.4.2 Creating a Command File to Run AUTOGEN with FEEDBACK 7.8.5 Setting Up a New Large VAXcluster System 7.8.6 Defining the VAXcluster Alias A Cluster SYSGEN Parameters B Building a Common SYSUAF.DAT File C Cluster Troubleshooting C.1 Diagnosing Failures of Computers to Boot or Join the Cluster C.1.1 Events for Computers Booting and Joining the Cluster C.1.2 CI-Connected Computer Fails to Boot C.1.3 Satellite Fails to Boot C.1.4 Computer Fails to Join the Cluster C.1.5 Startup Procedures Fail to Complete C.1.6 Diagnosing LAN Component Failures C.2 Diagnosing Cluster Hangs C.2.1 Cluster Quorum Is Lost C.2.2 A Shared Cluster Resource Is Inaccessible C.3 Diagnosing CLUEXIT Bugchecks C.4 Diagnosing VAXport Device Problems C.4.1 VAXport Communication Mechanisms C.4.2 Port Failures C.4.2.1 Verifying CI Port Functions C.4.2.2 Verifying CI Cable Connections C.4.2.3 Repairing CI Cables C.4.2.4 Verifying LAN Connections C.4.3 Analyzing Error Log Entries for VAXport Devices C.4.3.1 Error Log Entry Formats C.4.3.2 Device-Attention Entries C.4.3.3 Logged-Message Entries C.4.3.4 Error Log Entry Descriptions C.4.4 OPA0 Error Messages D Local Area VAXcluster Network Connections E Local Area VAXcluster Sample Programs E.1 Sample Programs for Local Area VAXclusters E.1.1 Starting the Local Area VAXcluster Protocol on a LAN Adapter E.1.2 Stopping the Local Area VAXcluster Protocol on a LAN Adapter E.1.3 Enabling VAXcluster Network Failure Analysis E.2 Using the Local Area VAXcluster Network Failure Analysis Program E.2.1 Collecting Information for the Network Failure Analysis Program E.2.2 Editing the Network Failure Analysis Program E.2.3 Assembling and Linking the Failure Analysis Program E.2.4 Executing the Network Failure Analysis Program E.2.5 Testing the Network Failure Analysis Subsystem E.2.6 PEDRIVER Suspect Network Component Display F Local Area VAXcluster Subroutine Package F.1 Subroutine Package to Start the Protocol on a LAN Adapter F.2 Subroutine Package to Stop the Protocol on a LAN Adapter F.3 Subroutine Package to Create a Network Component F.4 Subroutine Package to Create a Network Component List F.5 Subroutine Package to Start the Network Component Failure Analysis F.6 Subroutine Package to Stop the Network Component Failure Analysis G Transmit Channel Selection EXAMPLES 4-1 Sample Interactive Network Configuration Session 6-1 Sample Commands for Creating VAXcluster Queues 6-2 Common Procedure to Start VAXcluster Queues 7-1 Sample Interactive CLUSTER_CONFIG.COM Session to Add a CI-Connected Computer as a Boot Server 7-2 Sample Interactive CLUSTER_CONFIG.COM Session to Add a Satellite with Local Page and Swap Files 7-3 Sample NETNODE_UPDATE.COM File 7-4 Sample Interactive CLUSTER_CONFIG.COM Session to Remove a Satellite with Local Page and Swap Files 7-5 Sample Interactive CLUSTER_CONFIG.COM Session to Enable the Local Computer as a Disk Server 7-6 Sample Interactive CLUSTER_CONFIG.COM Session to Change the Local Computer's ALLOCLASS Value 7-7 Sample Interactive CLUSTER_CONFIG.COM Session to Enable the Local Computer as a Boot Server 7-8 Sample Interactive CLUSTER_CONFIG.COM Session to Change a Satellite's Hardware Address 7-9 Sample Interactive CLUSTER_CONFIG.COM Session to Convert a Standalone Computer to a Cluster Boot Server 7-10 Sample Interactive CLUSTER_CONFIG.COM CREATE Session 7-11 Sample SYSMAN Session to Change the Cluster Password C-1 CI Device-Attention Entry C-2 LAN Device-Attention Entry C-3 CI Logged-Message Entry E-1 Portion of LAVC$FAILURE_ANALYSIS.MAR to Edit FIGURES 2-1 Typical CI-Based VAXcluster Configuration 2-2 Local Area VAXcluster System with Single Boot Server 2-3 VAXcluster Configuration with Redundant Boot Servers and DSA Disks 2-4 Typical Mixed-Interconnect VAXcluster System 2-5 DSSI VAXcluster Configuration 2-6 FDDI VAXcluster System: Example Configuration 2-7 FDDI in Conjunction with Ethernet in a VAXcluster System 2-8 Multi-Datacenter VAXcluster System 2-9 Sample Two-LAN Segment VAXcluster Configuration 2-10 Sample Three-LAN Segment VAXcluster Configuration 3-1 Elements of a Shadow Set 3-2 Shadow Set Members Accessed Through the VMS MSCP Server 4-1 Directory Structure on Common System Disk 4-2 File Search Order on Common System Disk 5-1 CI-Based Configuration with Shared Disks and Tapes 5-2 VAXcluster with Dual-Pathed HSC Disk and Tape 5-3 VAXcluster with Dual-Pathed DSA Disk and Tape 5-4 Device Names in a Mixed-Interconnect Cluster 6-1 Sample Printer Configuration 6-2 Printer Queue Configuration 6-3 Clusterwide Generic Printer Queue Configuration 6-4 Sample Batch Queue Configuration 6-5 Clusterwide Generic Batch Queue Configuration C-1 A Correctly Connected Two-Computer CI Cluster C-2 Crossed CI Cable Pair D-1 Sample Transceiver/Thick Wire Ethernet Connection D-2 Sample DELNI Connection D-3 Sample DESTA Connection D-4 Sample Connection to an Existing Thin Wire Segment D-5 Sample New Connection to an Existing DEMPR TABLES 4-1 Information Requested for CI-Based Configurations 4-2 Information Requested for Local Area and Mixed-Interconnect Configurations 5-1 Specifying Values for MSCP_LOAD, MSCP_SERVE_ALL, and TMSCP_LOAD Parameters 7-1 Summary of CLUSTER_CONFIG.COM Functions 7-2 Data Requested by CLUSTER_CONFIG.COM 7-3 CLUSTER_CONFIG.COM CHANGE Options 7-4 Summary of SYSMAN CONFIGURATION Commands for Cluster Authorization 7-5 System Disk I/O Activity and Boot Time for Single Satellite 7-6 System Disk I/O Activity and Boot Times for Multiple Satellites 7-7 AUTOGEN Dump File Symbols A-1 Cluster SYSGEN Parameters