Contents

List of Tables

Title and Copyright Information

Preface

• Intended Audience
• Documentation Accessibility
• Related Documents
• Conventions

What's New in Oracle Grid Infrastructure Installation and Configuration?

• New Features for Release 2 (11.2.0.4)
• Desupported Options for Release 2 (11.2.0.4)
• New Features for Release 2 (11.2.0.3)
• New Features for Release 2 (11.2.0.2)
• New Features for Release 2 (11.2)
• New Features for Release 1 (11.1)

1 Typical Installation for Oracle Grid Infrastructure for a Cluster

• 1.1 Typical and Advanced Installation
• 1.2 Preinstallation Steps Completed Using Typical Installation
• 1.3 Preinstallation Steps Requiring Manual Tasks
  • 1.3.1 Verify System Requirements
  • 1.3.2 Check Network Requirements
    • 1.3.2.1 Single Client Access Name (SCAN) for the Cluster
    • 1.3.2.2 IP Address Requirements
    • 1.3.2.3 Redundant Interconnect Usage
    • 1.3.2.4 Intended Use of Network Interfaces
  • 1.3.3 Check Operating System Packages
  • 1.3.4 Create Groups and Users
  • 1.3.5 Configure Oracle Installation Owner Shell Limits
  • 1.3.6 Check Storage
  • 1.3.7 Prepare Storage for Oracle Automatic Storage Management
  • 1.3.8 Install Oracle Grid Infrastructure Software

2 Advanced Installation Oracle Grid Infrastructure for a Cluster Preinstallation Tasks

• 2.1 Reviewing Upgrade Best Practices
• 2.2 Installation Fixup Scripts
• 2.3 Logging In to a Remote System as root Using X Terminal
• 2.4 Creating Groups, Users and Paths for Oracle Grid Infrastructure
  • 2.4.1 Determining If the Oracle Inventory and Oracle Inventory Group Exists
  • 2.4.2 Creating the Oracle Inventory Group If an Oracle Inventory Does Not Exist
  • 2.4.3 Creating the Oracle Grid Infrastructure User
    • 2.4.3.1 Understanding Restrictions for Oracle Software Installation Owners
    • 2.4.3.2 Determining if an Oracle Software Owner User Exists
    • 2.4.3.3 Creating or Modifying an Oracle Software Owner User for Oracle Grid Infrastructure
  • 2.4.4 Creating the Oracle Base Directory Path
  • 2.4.5 Creating Job Role Separation Operating System Privileges Groups and Users
    • 2.4.5.1 Overview of Creating Job Role Separation Groups and Users
    • 2.4.5.2 Creating Database Groups and Users with Job Role Separation
  • 2.4.6 Example of Creating Standard Groups, Users, and Paths
  • 2.4.7 Example of Creating Role-allocated Groups, Users, and Paths
• 2.5 Checking the Hardware Requirements
• 2.6 Checking the Network Requirements
  • 2.6.1 Network Hardware Requirements
  • 2.6.2 IP Address Requirements
    • 2.6.2.1 IP Address Requirements with Grid Naming Service
    • 2.6.2.2 IP Address Requirements for Manual Configuration
  • 2.6.3 Broadcast Requirements for Networks Used by Oracle Grid Infrastructure
  • 2.6.4 Multicast Requirements for Networks Used by Oracle Grid Infrastructure
  • 2.6.5 DNS Configuration for Domain Delegation to Grid Naming Service
  • 2.6.6 Grid Naming Service Configuration Example
  • 2.6.7 Manual IP Address Configuration Example
  • 2.6.8 Network Interface Configuration Options
• 2.7 Identifying the Software Requirements
• 2.8 Checking the Software Requirements
• 2.9 Verifying UDP and TCP Kernel Parameters
• 2.10 Checking Resource Limits for AIX
• 2.11 Tuning AIX System Environment
  • 2.11.1 Checking Asynchronous Input Output Processes
  • 2.11.2 Tuning Virtual Memory Manager (VMM)
  • 2.11.3 Increasing System Block Size Allocation
  • 2.11.4 Configuring SSH LoginGraceTime Parameter for AIX
  • 2.11.5 Configuring Shell Limits
  • 2.11.6 Configuring User Process Parameters
  • 2.11.7 Configuring Network Tuning Parameters
• 2.12 Network Time Protocol Setting
• 2.13 Automatic SSH Configuration During Installation
• 2.14 Configuring Grid Infrastructure Software Owner User Environments
  • 2.14.1 Environment Requirements for Oracle Grid Infrastructure Software Owner
  • 2.14.2 Environment Requirements for Oracle Database and Oracle ASM Owners
  • 2.14.3 Procedure for Configuring Oracle Software Owner Environments
  • 2.14.4 Setting Display and X11 Forwarding Configuration
  • 2.14.5 Preventing Installation Errors Caused by Terminal Output Commands
• 2.15 Running the rootpre.sh Script
• 2.16 Adding the Grid Infrastructure Installation Owner to Hagsuser Group
• 2.17 Requirements for Creating an Oracle Grid Infrastructure Home Directory
• 2.18 Cluster Name Requirements

3 Configuring Storage for Oracle Grid Infrastructure and Oracle RAC

• 3.1 Reviewing Oracle Grid Infrastructure Storage Options
  • 3.1.1 Overview of Oracle Clusterware and Oracle RAC Storage Options
    • 3.1.1.1 Quorum Disk Location Restriction with Existing 9.2 Clusterware Installations
    • 3.1.1.2 After You Have Selected Disk Storage Options
  • 3.1.2 General Information About Oracle ACFS
  • 3.1.3 General Storage Considerations for Oracle Grid Infrastructure and Oracle RAC
    • 3.1.3.1 General Storage Considerations for Oracle Clusterware
    • 3.1.3.2 General Storage Considerations for Oracle RAC
  • 3.1.4 Guidelines for Using Oracle ASM Disk Groups for Storage
  • 3.1.5 Using Logical Volume Managers with Oracle Grid Infrastructure and Oracle RAC
  • 3.1.6 Supported Storage Options
  • 3.1.7 After You Have Selected Disk Storage Options
• 3.2 Shared File System Storage Configuration
  • 3.2.1 Requirements for Using a Shared File System
  • 3.2.2 Deciding to Use a Cluster File System for Oracle Clusterware Files
  • 3.2.3 Deciding to Use Direct NFS Client for Data Files
    • 3.2.3.1 About Direct NFS Client Storage
    • 3.2.3.2 Using the oranfstab File with Direct NFS Client
    • 3.2.3.3 Mounting NFS Storage Devices with Direct NFS Client
    • 3.2.3.4 Specifying Network Paths with the Oranfstab File
  • 3.2.4 Deciding to Use NFS for Data Files
  • 3.2.5 Configuring Storage NFS Mount and Buffer Size Parameters
  • 3.2.6 Enabling Direct NFS Client Oracle Disk Manager Control of NFS
  • 3.2.7 Configuring HACMP Multinode Disk Heartbeat (MNDHB)
    • 3.2.7.1 Overview of Requirements for Using HACMP with Oracle Clusterware
    • 3.2.7.2 Deploying HACMP and MDNDHB for Oracle Clusterware
    • 3.2.7.3 Upgrading an Existing Oracle Clusterware and HACMP Installation
  • 3.2.8 Configuring Raw Logical Volumes for Oracle Clusterware
  • 3.2.9 Configuring New Oracle Clusterware Volume Group Raw Logical Volumes
  • 3.2.10 Creating a Volume Group for Database Files
  • 3.2.11 Creating a Volume Group for Oracle Clusterware
  • 3.2.12 Importing the Volume Group on the Other Cluster Nodes
  • 3.2.13 Activating the Volume Group in Concurrent Mode on All Cluster Nodes
  • 3.2.14 Creating Directories for Oracle Clusterware Files on Shared File Systems
  • 3.2.15 Creating Directories for Oracle Database Files on Shared File Systems
  • 3.2.16 Disabling Direct NFS Client Oracle Disk Management Control of NFS
• 3.3 Oracle Automatic Storage Management Storage Configuration
  • 3.3.1 Configuring Storage for Oracle Automatic Storage Management
    • 3.3.1.1 Identifying Storage Requirements for Oracle ASM
    • 3.3.1.2 Creating Files on a NAS Device for Use with Oracle ASM
  • 3.3.2 Using an Existing Oracle ASM Disk Group
  • 3.3.3 Configuring Disk Devices for Oracle ASM
  • 3.3.4 Using Disk Groups with Oracle Database Files on Oracle ASM
    • 3.3.4.1 Using Existing Oracle Database Disk Groups on Oracle ASM
    • 3.3.4.2 Creating Disk Groups for Oracle Database Data Files
  • 3.3.5 Configuring Oracle Automatic Storage Management Cluster File System
  • 3.3.6 Upgrading Existing Oracle ASM Instances
• 3.4 Desupport of Raw Disks

4 Installing Oracle Grid Infrastructure for a Cluster

• 4.1 Preparing to Install Oracle Grid Infrastructure with OUI
• 4.2 Installing Grid Infrastructure
  • 4.2.1 Running OUI to Install Grid Infrastructure
  • 4.2.2 Installing Grid Infrastructure Using a Cluster Configuration File
• 4.3 Installing Grid Infrastructure Using a Software-Only Installation
  • 4.3.1 Installing the Software Binaries
  • 4.3.2 Configuring the Software Binaries
  • 4.3.3 Configuring the Software Binaries Using a Response File
• 4.4 Restrictions for Oracle Berkeley DB
• 4.5 Confirming Oracle Clusterware Function
• 4.6 Confirming Oracle ASM Function for Oracle Clusterware Files
• 4.7 Confirming Oracle Clusterware Function

5 Oracle Grid Infrastructure Postinstallation Procedures

• 5.1 Required Postinstallation Tasks
  • 5.1.1 Download and Install Patch Updates
• 5.2 Recommended Postinstallation Tasks
  • 5.2.1 Back Up the root.sh Script
  • 5.2.2 Tune Semaphore Parameters
  • 5.2.3 Create a Fast Recovery Area Disk Group
    • 5.2.3.1 About the Fast Recovery Area and the Fast Recovery Area Disk Group
    • 5.2.3.2 Creating the Fast Recovery Area Disk Group
  • 5.2.4 Running RACcheck Configuration Audit Tool
• 5.3 Using Older Oracle Database Versions with Grid Infrastructure
  • 5.3.1 General Restrictions for Using Older Oracle Database Versions
  • 5.3.2 Using ASMCA to Administer Disk Groups for Older Database Versions
  • 5.3.3 Pinning Cluster Nodes for Oracle Database Release 10.x or 11.x
  • 5.3.4 Enabling The Global Services Daemon (GSD) for Oracle Database Release 9.2
  • 5.3.5 Using the Correct LSNRCTL Commands
• 5.4 Modifying Oracle Clusterware Binaries After Installation

6 How to Modify or Deinstall Oracle Grid Infrastructure

• 6.1 Deciding When to Deinstall Oracle Clusterware
• 6.2 Migrating From Oracle Restart to Oracle Clusterware
• 6.3 Relinking Oracle Grid Infrastructure for a Cluster Binaries
• 6.4 Changing the Oracle Grid Infrastructure Home Path
• 6.5 Deconfiguring Oracle Clusterware Without Removing Binaries
• 6.6 Removing Oracle Clusterware and Oracle ASM
  • 6.6.1 About the Deinstallation Tool
  • 6.6.2 Deinstalling Previous Release Grid Home
  • 6.6.3 Downloading The Deinstall Tool for Use with Failed Installations
  • 6.6.4 Running The Deinstallation Tool
  • 6.6.5 Deinstall Command Example for Oracle Clusterware and Oracle ASM
  • 6.6.6 Deinstallation Parameter File Example for Grid Infrastructure for a Cluster

A Troubleshooting the Oracle Grid Infrastructure Installation Process

• A.1 General Installation Issues
• A.2 Interpreting CVU "Unknown" Output Messages Using Verbose Mode
• A.3 Interpreting CVU Messages About Oracle Grid Infrastructure Setup
• A.4 About the Oracle Grid Infrastructure Alert Log
• A.5 Troubleshooting Issues on AIX
• A.6 Performing Cluster Diagnostics During Oracle Grid Infrastructure Installations
• A.7 About Using CVU Cluster Healthchecks After Installation
• A.8 Interconnect Configuration Issues
• A.9 SCAN VIP and SCAN Listener Issues
• A.10 Storage Configuration Issues
  • A.10.1 Recovery from Losing a Node Filesystem or Grid Home

B Installing and Configuring Oracle Database Using Response Files

• B.1 How Response Files Work
  • B.1.1 Reasons for Using Silent Mode or Response File Mode
  • B.1.2 General Procedure for Using Response Files
• B.2 Preparing a Response File
  • B.2.1 Editing a Response File Template
  • B.2.2 Recording a Response File
• B.3 Running the Installer Using a Response File
• B.4 Running Net Configuration Assistant Using a Response File
• B.5 Postinstallation Configuration Using a Response File
  • B.5.1 About the Postinstallation Configuration File
  • B.5.2 Running Postinstallation Configuration Using a Response File

C Oracle Grid Infrastructure for a Cluster Installation Concepts

• C.1 Understanding Preinstallation Configuration
  • C.1.1 Understanding Oracle Groups and Users
    • C.1.1.1 Understanding the Oracle Inventory Group
    • C.1.1.2 Understanding the Oracle Inventory Directory
  • C.1.2 Understanding the Oracle Base Directory Path
    • C.1.2.1 Overview of the Oracle Base directory
    • C.1.2.2 Understanding Oracle Base and Grid Infrastructure Directories
  • C.1.3 Understanding Network Addresses
    • C.1.3.1 About the Public IP Address
    • C.1.3.2 About the Private IP Address
    • C.1.3.3 About the Virtual IP Address
    • C.1.3.4 About the Grid Naming Service (GNS) Virtual IP Address
    • C.1.3.5 About the SCAN
  • C.1.4 Understanding Network Time Requirements
• C.2 Understanding Storage Configuration
  • C.2.1 Understanding Oracle Automatic Storage Management Cluster File System
  • C.2.2 About Migrating Existing Oracle ASM Instances
  • C.2.3 About Converting Standalone Oracle ASM Installations to Clustered Installations
• C.3 Understanding Server Pools
  • C.3.1 Overview of Server Pools and Policy-based Management
  • C.3.2 How Server Pools Work
  • C.3.3 The Free Server Pool
  • C.3.4 The Generic Server Pool
• C.4 Understanding Out-of-Place Upgrade

D How to Complete Installation Prerequisite Tasks Manually

• D.1 Configuring SSH Manually on All Cluster Nodes
  • D.1.1 Checking Existing SSH Configuration on the System
  • D.1.2 Configuring SSH on Cluster Nodes
    • D.1.2.1 Create SSH Directory, and Create SSH Keys On Each Node
    • D.1.2.2 Add All Keys to a Common authorized_keys File
  • D.1.3 Enabling SSH User Equivalency on Cluster Nodes

E How to Upgrade to Oracle Grid Infrastructure 11g Release 2

• E.1 Back Up the Oracle Software Before Upgrades
• E.2 Unset Oracle Environment Variables
• E.3 About Oracle ASM and Oracle Grid Infrastructure Installation and Upgrade
• E.4 Restrictions for Clusterware and Oracle ASM Upgrades
• E.5 Preparing to Upgrade an Existing Oracle Clusterware Installation
  • E.5.1 Checks to Complete Before Upgrade an Existing Oracle Clusterware Installation
  • E.5.2 Running the Oracle RACcheck Upgrade Readiness Assessment
• E.6 Using CVU to Validate Readiness for Oracle Clusterware Upgrades
  • E.6.1 About the CVU Grid Upgrade Validation Command Options
  • E.6.2 Example of Verifying System Upgrade Readiness for Grid Infrastructure
  • E.6.3 Verifying System Readiness for Oracle Database Upgrades
• E.7 Performing Rolling Upgrades From an Earlier Release
  • E.7.1 Performing a Rolling Upgrade of Oracle Clusterware
  • E.7.2 Performing a Rolling Upgrade of Oracle Automatic Storage Management
    • E.7.2.1 Preparing to Upgrade Oracle ASM
    • E.7.2.2 Upgrading Oracle ASM
• E.8 Updating DB Control and Grid Control Target Parameters
• E.9 Unlocking the Existing Oracle Clusterware Installation
• E.10 Downgrading Oracle Clusterware After an Upgrade
• E.11 Checking Cluster Health Monitor Repository Size After Upgrading

Index