| Asset ID: |
1-71-1007858.1 |
| Update Date: | 2011-03-29 |
| Keywords: | |
Solution Type
Technical Instruction Sure
Solution
1007858.1
:
Sun Fire[TM] Midrange System: UltraSPARC[R] IV+ (USIV+) System Board Upgrade Requirements
| Related Items |
- Sun Fire E6900 Server
- Sun Fire 6800 Server
- Sun Fire E4900 Server
- Sun Fire 4800 Server
- Sun Fire V1280 Server
- Sun Fire E2900 Server
|
| Related Categories |
- GCS>Sun Microsystems>Servers>Midrange V and Netra Servers
- GCS>Sun Microsystems>Servers>Midrange Servers
|
PreviouslyPublishedAs
210854
Applies to:
Sun Fire E6900 Server
Sun Fire V1280 Server
Sun Fire 4800 Server
Sun Fire 6800 Server
Sun Fire E2900 Server
All Platforms
Goal
Description
UltraSPARC IV+ (USIV+ or Ultra Sparc Four Plus) System Board upgrade requirements for Sun Fire v1280, E2900, 4800, E4900, 6800, or E6900 servers.
The upgrade requirements for the Sun Fire[TM] Midrange System
product line and the USIV+ System Boards are
available on a component by component basis from the Sun System
Handbook. To determine what is required for such an upgrade, you can refer to
each of the individual component pages to get all of the information
necessary to prepare for the upgrade process.
There are three (3)
types of USIV+ boards available: 1500MHz, 1800MHz, and 1950MHz.
The purpose of this document is to combine all of the individual
component resources into one quick reference guide. This
reference guide will provide information on what requirements must be
met prior to installing any any USIV+ board into a Sun Fire[TM]
Midrange System. It is important to note the following with regards
to USIV+ and these systems:
- Sun Fire 3800 and 4810 servers do NOT support USIV+ so they are excluded from this document.
- Sun Fire 4800 and 6800 servers support USIV+ with upgrades.
- Sun Fire 4900 servers support USIV+ 1500MHz native and 1800, 1950 MHz with upgrades.
- Sun Fire 6900 servers support USIV+ 1500 & 1800MHz native.
- Sun Fire E2900/V1280 servers support USIV+ 1500 native.
Some of the
requirements are essentially the same as those referenced for
upgrading to USIV boards (See <Document:1006342.1> for that
discussion). However there are some important distinctions and
differences in the requirements, so be careful to review the
information detailed below carefully.
This document also describes three additional topics which are:
Solution
Solaris
OS & System Controller Application (ScApp) Requirements
1.
Domain Operating System (OS) must be Solaris 9 09/05 s9u8, or Solaris
10 HW1.
- Solaris
8 (any revision) does not support USIV+ boards.
- Support
for USIV+ using Solaris 9 09/04 s9u7 and a specific set of patches
was qualified by Engineering.
The
recommendation and preference is still to do a full upgrade or
install of s9u8.
If
a customer chooses to apply patches starting with an initial revision
of s9u7, the list of patches required to support USIV+ is: 117171-17
118558-11 113073-14 117427-08 114380-04 115669-03 116009-05
116557-04 117124-10
116532-02
112233-12 114129-02 114127-03 113495-05 are also patches
required, but which should already be included in s9u7.
In
the case of all patches above, these are the minimum revisions
required. Higher revisions of the patches are supported since the
patches are cumulative. These patches can be located by searching
for their patch ID on the Patches
& Updates
tab in the My Oracle Support portal.
2.
System Controller minimum
version is ScApp 5.19.1. for 1500MHz USIV+, 5.20.1 for 1800MHz USIV+
and 5.20.4 for 1950MHz.
NOTE: ScApp
5.20.14 should be the minimum version installed on Sun Fire E2900 and
V1280 systems. See Alert <Document:1021703.1> for details.
- Reference
the install.info file which accompanies the ScApp firmware patch <Patch:10111418> for
firmware install information.
- Engineering
recommends utilizing the latest ScApp release to take advantage of
the most recent enhancements and fixes available.
- The
importance of this suggestion is demonstrated by CR 6319704 which
occurs on 5.19.1 and could result in domain panics. The fix,
integrated into 5.19.3, shows that keeping ScApp firmware up to date
insures platform reliability.
Sun
Fire 4800 Requirements
1.
Domain OS and ScApp requirements listed above.
2.
Upgrade the system Power Supply Units (PSUs).
- 1500MHz
USIV+ Boards require pn 300-1596
or 300-1931 (A185)
- 1800MHz
and 1950MHz USIV+ Boards require pn 300-1837
(A213)
- Mixed
PSUs in the same platform is not a supported configuration except
when performing this USIV/USIV+ PSU upgrade procedure.
3.
Upgrade
Fan Trays (FTs).
Notes
on upgrading:
- The
upgrade kit, 4800-USIV-KIT
or 4800-USIV-KIT-Z,
contains all required components necessary to support USIV boards
and up to 1500MHz USIV+ boards.
- The
upgrade kit, XE4900-USIV+KIT
or XE4900-USIV+KIT-Z,
contains all required components necessary to support all boards
currently released (up to 1950 MHz USIV+ at present).
- The
new hardware (PSUs, FTs, and USIV+ boards) cannot be installed until
the firmware is updated.
- The
hardware on a 4800 server can be upgraded to support USIV+ boards
without shutting down the platform. The OS upgrade will, however,
require a domain reboot and the ScApp firmware update will not fully
take effect until the domains are keyswitched off and back on again.
Sun
Fire 4900 server
1.
Domain OS and ScApp requirements listed above.
2.
No hardware upgrades are necessary to support USIV+.
- From
the factory, the 4900 system comes with all required hardware
components to support 1500MHz USIV+ boards.
- 1800MHz
and 1950MHz have the same requirements as the list for the 4800
above.
Sun
Fire 6800 server
1.
Domain OS and ScApp requirements listed above.
2.
Upgrade Power Supply Units.
- USIV+
(1500MHz & 1800MHz) Boards require pn 300-1595
(A184), 300-1930 (A184), or 300-1836 (A212).
- USIV+
1950 requires 300-1836 (A212)
- ScApp
5.20.1 had a restriction requiring A212 PSUs, but the restriction
was "lifted" for 1500MHz & 1800MHz boards in 5.20.2
and higher.
- Mixed
PSUs in the same platform is not a supported configuration except
when performing this USIV/USIV+ PSU upgrade procedure.
3.
Upgrade EMI Gasket.
4.
Upgrade Level 2 Repeaters (RPs) if intending to configure 4 domains
with USIV+.
- V2
RPs are NOT a requirement to operate USIV+ boards.
- V2
RPs ARE a requirement (in addition to at least ScApp 5.20.1) in
order to operate USIV+ boards in dual domains per partition (all 4
domains on 6800/E6900).
- The
V2 RP is pn 501-7594.
Notes
on upgrading:
- New
PSUs, FTs, and USIV+ boards cannot be installed until the ScApp
firmware is updated. The latest version of ScApp is available via
<Patch:10111418>.
- The
upgrade process requires a complete platform shut down, due to the
required upgrade of the EMI gaskets.
- If
running ScApp 5.20.1, the upgrade kit XE6900-USIV+KIT-Z
is required to allow 1800MHz USIV+ boards because this kit contains
the A212 PSUs which ScApp 5.20.1 was restricted to use.
- If
running > ScApp 5.20.1, the PSU restriction was lifted, and the
upgrade kits, X6800-USIV-KIT
or X6800-USIV-KIT-Z
contain the required components necessary to support all boards
currently released (up to 1800MHz USIV+).
- The
V2 RP upgrade kit, XE6900-FP-SWITCH-Z,
includes all 4 RPs needed to allow all 4 domains to be configured
using USIV+ boards if ScApp is >5.20.1. Prior to this ScApp and
RP version, USIV+ boards were restricted to a single domain per
partition configuration (Domains A & C only).
- To
enable 4 domains support following hardware and ScApp upgrade,
utilize the setupplatform
command options usiv+
and dual-domains
as detailed in the Using
UltraSPARC IV+ System Boards in Domains from the Sun Fire
Midrange Systems Firmware 5.20.1 Release Notes (applicable for newer
releases of 5.20.x ScApp too).
- Be
aware of FAB <Document:1017415.1> The
Performance Impact Of Configuring Two Domains In a Single Partition
Can Be More Significant When Using UltraSparc IV+ Processors
as it relates to V2 Repeaters.
Sun
Fire 6900 server
1.
Domain OS and ScApp requirements listed above.
2.
No hardware upgrades are necessary to support USIV+.
- From
the factory, the E6900 system comes with all required components to
support 1500MHz.
- 1800MHz
USIV+ boards will require ScApp 5.20.1 and 1950MHz USIV+ requires
PSU 300-1836 (A212) available in upgrade kit XE6900-USIV+KIT-Z
and ScApp 5.20.4.
3.
Upgrade Level 2 Repeaters (RPs) if intending to configure 4 domains
with USIV+.
- V2
RPs are NOT a requirement to operate USIV+ boards.
- V2
RPs ARE a requirement (in addition to at least ScApp 5.20.1) in
order to operate USIV+ boards in dual domains per partition (all 4
domains on 6800/E6900).
- The
V2 RP is pn 501-7594.
Notes
on upgrading:
- The
V2 RP upgrade kit, XE6900-FP-SWITCH-Z,
includes all 4 RPs needed to allow all 4 domains to be configured
using USIV+ boards if ScApp is >5.20.1. Prior to this ScApp and
RP version, USIV+ boards were restricted to a single domain per
partition configuration (Domains A & C only).
- To
enable 4 domains support following hardware and ScApp upgrade,
utilize the setupplatform
command options usiv+
and dual-domains
as detailed in the Using
UltraSPARC IV+ System Boards in Domains from the Sun Fire
Midrange Systems Firmware 5.20.1 Release Notes (applicable for newer
releases of 5.20.x ScApp too).
- Be
aware of FAB <Document:1017415.1> The
Performance Impact Of Configuring Two Domains In a Single Partition
Can Be More Significant When Using UltraSparc IV+ Processors
as it relates to V2 Repeaters.
Sun
Fire E2900/V1280 server
1.
Domain OS and ScApp requirements listed above.
2.
Remove the Left Input Air Filter per the instructions detailed in
Alert <Document:1021703.1>.
3.
No hardware upgrades are necessary. to support USIV+
- From
the factory, the E2900/V1280 systems comes with all required
components to support 1500MHz USIV+ boards.
- 1800MHz
boards require Scope 5.20.1 and A209 PSU's and the 1950MHz require
5.20.4, the A209 PSU and the removal of the filter in the left hand
door.
- The
A209 PSU's are available in the current upgrade kit,
XE2900-USIV+KIT-Z.
Upgrade
Procedure Recommendations
1.
The new hardware is dependent on the OS and ScApp firmware so you
should update these first. Use the following steps:
-
Update the firmware (flashupdate or lom -g) on the SCs and boards
as detailed
in the install.info file contained in the firmware patch.
-
Reboot the SCs as required by the firmware update process.
-
Upgrade the domain OS as needed (refer to Solaris
Installation/Upgrade documentation).
-
Shut down the domain after the upgrade process has been completed.
-
Power off the platform.
2.
If this is a 6800 system, power off the platform and install the EMI
Gaskets.
3.
Upgrade the power supplies (and fan trays if 4800).
4.
Power the platform back on.
5.
If on a 4800/4900/6800/6900 system, configure the system to support
USIV+ boards.
- Run
the command setupplatform
-p usiv+
on the SC and answer TRUE
to enable USIV+ support in the partitions.
- If
V2 RPs have been installed and you will be running USIV+ in dual
domains per partition (6800/E6900 only), run the command
setupplatform
-p dual-domains and
answer TRUE
for the partitions to be enabled for this support.
6.
Verify firmware versions on all boards are at the same firmware level
and upgrade the firmware as needed.
7.
Assign and configure USIV+ boards to domains and test them.
-
Install the new System Boards either using DR operation or when
the domains
are still shut down.
-
Consider increasing POST level to max diags since the hardware is
new, and
either use DR to perform testing on the single board or use
setkeyswitch on to
POST the entire domain.
- Monitor for any errors in POST related to the new boards.
Refer
to Sun
Fire High-End and Midrange Systems CPU/Memory Board Installation
Guide
(pdf).
Utilizing
USIV+ in Domains
ScApp
"setupplatform" Command Parameters
# setupplatform -p usiv+
- In
ScApp 5.19.0 firmware the parameter usiv+ was added to allow
UltraSPARC IV+ support.
- Prior
to V2 RP availability (and ScApp 5.20.1), this setting restricted
USIV+ support to domains A and C only (single domain per partition).
# setupplatform -p dual-domains
The
following 2 examples illustrates the introduction of UltraSPARC IV+
system boards into domain environments without ensuring USIV+ support
is provisioned for the domain concerned:
Introducing
a USIV+ based SB into a domain using DR w/o ensuring USIV+ support
v4u-4800b-sc0:SC> showplatform -p usiv+
UltraSPARC IV+ is not supported in domain A
UltraSPARC IV+ is not supported in domain C
# cfgadm
Ap_Id Type Receptacle Occupant Condition
N0.IB6 PCI_I/O_Boa connected configured ok
N0.IB8 PCI_I/O_Boa connected configured ok
N0.SB0 CPU_V2 connected configured ok
N0.SB4 CPU_V3 disconnected unconfigured unknown
c0 scsi-bus connected configured unknown
# cfgadm -v -c configure N0.SB4
assign N0.SB4
assign N0.SB4 done
poweron N0.SB4
Aug 01 19:53:05 v4u-4800b-sc0 Domain-A.SC: ERROR: UltraSPARC IV+ CPUs detected in this domain.
Domain is not set up to support UltraSPARC IV+.
Please setkey off this domain, run setupplatform to support UltraSPARC IV+ CPUs in domain A.
cfgadm: Hardware specific failure: poweron N0.SB4: Invalid argument
Introducing
a USIV+ based SB into a domain using a keyswitch operation w/o
ensuring USIV+ support
v4u-4800b-sc0:SC> showplatform -p usiv+
UltraSPARC IV+ is not supported in domain A
UltraSPARC IV+ is not supported in domain C
v4u-4800b-sc0:A> showboards
Slot Pwr Component Type State Status Domain
---- --- -------------- ----- ------ ------
/N0/SB0 On CPU Board V2 Active Passed A
/N0/SB4 On CPU Board V3 Assigned Not tested A
/N0/IB6 On PCI I/O Board Active Passed A
/N0/IB8 On PCI I/O Board Active Passed A
v4u-4800b-sc0:A> setkeyswitch standby
v4u-4800b-sc0:A> setkeyswitch on
Powering boards on ...
Aug 01 20:15:14 v4u-4800b-sc0 Domain-A.SC: ERROR: UltraSPARC IV+ CPUs detected in this domain.
Domain is not set up to support UltraSPARC IV+.
Please setkey off this domain, run setupplatform to support UltraSPARC IV+ CPUs in domain A.
setkeyswitch operation did not complete
keyswitch is: standby
To
address the above USIV+ support condition on the domain concerned,
execute the setupplatform command with the usiv+ option (although, it
must be noted that the changes desired will only take place while all
domains in the affected partitions are off):
v4u-4800b-sc0:SC> setupplatform -p usiv+
UltraSPARC IV+ Configuration
----------------------------
Is UltraSPARC IV+ going to be deployed in domain A [false]: true
Domain A keyswitch position is standby. The position must be off.
Can not change this value when the above domains are powered on.
v4u-4800b-sc0:SC> setkeyswitch -d A off
Powering boards off ...
v4u-4800b-sc0:SC> setupplatform -p usiv+
UltraSPARC IV+ Configuration
----------------------------
Is UltraSPARC IV+ going to be deployed in domain A [false]: true
Is UltraSPARC IV+ going to be deployed in domain C [false]: false
v4u-4800b-sc0:SC> showplatform -p usiv+
UltraSPARC IV+ is supported in domain A
UltraSPARC IV+ is not supported in domain C
The
above initiation of US IV+ based system board support on domain A
will provide the necessary foundation for the introduction of any
USIV+ based system boards into the domain A environment:
# cfgadm -v -c configure N0.SB4
assign N0.SB4
assign N0.SB4 done
poweron N0.SB4
:
connect N0.SB4 done
configure N0.SB4
configure N0.SB4 done
notify online SUNW_cpu/cpu16
notify online SUNW_cpu/cpu528
notify online SUNW_cpu/cpu17
notify online SUNW_cpu/cpu529
notify online SUNW_cpu/cpu18
notify online SUNW_cpu/cpu530
notify online SUNW_cpu/cpu19
notify online SUNW_cpu/cpu531
notify add capacity (8 cpus)
notify add capacity (4194304 pages)
notify add capacity N0.SB4 done
References
Internal
Information:
Sun
Fire E2900/V1280 ScApp and Filter recommendations:
- Customer
Ready: <Document:1021703.1>
- Internal
Only: <Document:1021064.1>
Previously
Published As 83102
Attachments
This solution has no attachment
