Sun Microsystems, Inc.  Sun System Handbook - ISO 3.4 June 2011 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-73-1000816.1
Update Date:2010-09-02
Keywords:

Solution Type  FAB (standard) Sure

Solution  1000816.1 :   Firmware upgrade required when replacing the CP1500 CPU on the System Controller of a Sun Fire 15K system.  


Related Items
  • Sun Fire 12K Server
  •  
  • Sun Fire 15K Server
  •  
Related Categories
  • GCS>Sun Microsystems>Sun FAB>Standard>Reactive
  •  

PreviouslyPublishedAs
201095


Product
Sun Fire 12K Server
Sun Fire 15K Server

Part
  • Part No: 501-5473-xx
  • Part Description: ASSY NORD-RED 440MHZ 2MBE$
  • Part Model: 2MBE$ -

Impact

When inserting a common off-the-shelf CP1500 CPU board (501-5473-xx) into a Sun Fire 12K/15K System Controller (SC) without updating the firmware on the FPROMS, the System Management Software (SMS) will not be able to start correctly (if at all), leaving the entire SC in an unusable state. This condition will prevent the use of any SMS commands and make it impossible to power-up system boards or boot domains on the Sun Fire 12K/15K.

FPROMs for the Nordica include the OBP and two user PROMS, which house SMS version specific firmware. CP1500 boards installed as FRUs will not contain firmware compatible with the installed SMS software because there is no manufacturing part number or FRU part number for a CP1500 board programmed with Sun Fire 12K/15K firmware. Therefore, every replacement of a defective CP1500 requires that the firmware versions be verified and updated as needed.

In addition to the above, the common off-the-shelf CP1500 CPU board might be shipped with OBP settings that prevent it from properly booting Solaris.

In addition, there are other cases where the FPROMs on the CP1500 board may have to be upgraded:

  • Bug fixes for the proper functioning of the system controller.
  • RFEs for maintainability.
  • New features introduced, such as support for new Solaris versions.

Please follow the instructions listed below to verify firmware and OBP settings on CP1500 boards and to update that firmware and OBP settings if needed.


Symptoms


Resolution

1. At the SC OBP, verify the CP1500 (the output below is just an example, output might be different depending on the Nordica):

ok show-dropins
Dropins for Flash device: /pci@1f,0/pci@1,1/ebus@1/flashprom@10,0
-----------------------------------------------------------------------
Dropin name      Size  Checksum  Date        Date       Version  Vendor
created     flashed
-----------------------------------------------------------------------
OBP              48e0c    5726   08/16/1999              3.10.24
keyboards          bf0    dd75
fonts              af6    6b86
obdiag            bd34    aec5
pci1002,5654       d1c    93eb
pci1002,4755       c94    3f95
class060400        44c    a3d4
userprom           246    b3ba
pci108e,1001      3254    5294
pci1011,22         478      1e
pci1000,3         2824    feb4
class010100       119a    51e7
i2c                1fe    5a8f
i2c-cs2            1f4    bd2a
POST             45390    d087   04/02/1999              1.15.0
-----------------------------------------------------------------------
PROM size = 100000 bytes    Available for Use = 40754 bytes
-----------------------------------------------------------------------
Dropins for Flash device: /pci@1f,0/pci@1,1/ebus@1/flashprom@10,400000
-----------------------------------------------------------------------
Dropin name      Size  Checksum  Date        Date       Version  Vendor
created     flashed
-----------------------------------------------------------------------
-----------------------------------------------------------------------
PROM size = 200000 bytes    Available for Use = 200000 bytes
-----------------------------------------------------------------------
Dropins for Flash device: /pci@1f,0/pci@1,1/ebus@1/flashprom@10,800000
-----------------------------------------------------------------------
Dropin name      Size  Checksum  Date        Date       Version  Vendor
created     flashed
-----------------------------------------------------------------------
-----------------------------------------------------------------------
PROM size = 200000 bytes    Available for Use = 200000 bytes
-----------------------------------------------------------------------

2. At the SC OBP, verify the CP1500 OBP settings to be setup to properly boot Solaris:

ok setenv diag-level max
ok setenv diag-switch? true
ok setenv auto-boot? true
ok setenv boot-device XXXXXXXXXX (whatever is appropriate)
ok setenv diag-device XXXXXXXXXX (whatever is appropriate)

After having verified the CP1500 OBP settings perform a hard reset of the CP1500 by pressing the reset button (the upper button just below the LEDs) on the front panel of the CP1500.

3. Boot the System Controller to Solaris. In most cases, SMS will not start.

   If your OBP version (3.10.24 above) is:              Action:
less than 3.14.6				  	Go to Step 4
at 3.14.6						Go to Step 7
greater than 3.14.6					Replace the CP1500**

It is possible to use a network boot and a /tftpboot OBP image. However, it is a difficult procedure. The recommended course of action is to replace the CP1500. We expect firmware above 3.14.6 to be a rare occurance.

4. Obtain the Update.to.nordica-red.3.14.6.starcat@OS script from:

  • http://pts-americas.west/esg/hsg/starcat/patches/Nordia-update-current.tar.Z

NOTE: This script and its version on OBP (3.14.6) must be used for System Controllers.  Any other version of software, including those that are higher, can render the System Controller unusable and are not supported.

5. Nordia-update-current.tar.Z in a temporary directory:

   % ls -al
total 3482
drwxr-xr-x   2 mf82242  tsg          512 Dec  7 13:59 .
drwxr-xr-x  23 mf82242  tsg         1024 Dec  7 14:53 ..
       -rw-r--r--   1 mf82242  tsg       780635 Dec  7 13:59  Nordia-update-current.tar.Z
-rw-r--r--   1 mf82242  tsg         2872 Nov 30 14:59  Release.Notes.3.14.6.starcat
       -rwxr-xr-x   1 mf82242  tsg       973822 Nov 30 14:59  Update.to.nordica-red.3.14.6.starcat@OS

6. (As ROOT) Execute ./Update.to.nordica-red.3.14.6.starcat@OS

# ./Update.to.nordica-red.3.14.6.starcat@OS
****************************************************
*  Running Update.to.nordica-red.3.14.6.starcat@OS *
*  Generated Wed Dec 10 13:06:41 PST 1997          *
****************************************************
WARNING: This Program will write a new PROM image.
Are you sure you want to do this?
Enter 'C' to Continue installation or 'T' to Terminate C
Stripping bundled file: done
Decoding and untaring: done
Verifying checksums: done
Installing flashprom driver file: done
WARNING:  Updating Flash PROM with new system firmware in progress...
It may take a few minutes.
******   DO NOT INTERRUPT OR POWER-DOWN THE SYSTEM   *******
Updating SPARCengine(tm)Ultra(tm) CP 1500  PROM
1 Erasing ... Done.
1 Verifying Erase ... Done.
1 Programming ... Done.
1 Verifying Program ... Done.
***** Update.to.nordica-red.3.14.6.starcat@OS Completed Successfully
****************************************************************
*   NOTE: updated Firmware takes effect after next reboot or   *
*   Power cycle of the system.                                 *
*   If there is any configuration support to become effective, *
*   you have to use -r with your boot command                  *
****************************************************************

7. (As platform administrator) Flash User PROMs

IMPORTANT NOTE FOR SITES RUNNING SMS 1.3

Sites running SMS 1.3 must install patch 115776-01 or higher due to bug 4797191. It will not be possible to flashupdate the SC until this patch is installed.

NOTE: If this is a Nordica on SC0, replace the SC1 with SC0 (i.e. SC1/FP1 becomes SC0/FP0 and SC1/FP1 becomes SC0/FP1). It is only possible to 'flashupdate' the PROMs on the local SC.

   sc1:sms-svc:19> /opt/SUNWSMS/bin/flashupdate -f /opt/SUNWSMS/firmware/SCOBPimg.di SC1/FP0
Current SC FPROM Information
============================
ERROR: Invalid FPROM segment at offset 0.
SC Flash Image Information
==========================
Name: SSCOBP-dropins, Version: 1.1
Size: 144, Check Sum: 52795
Date Flashed: 08/23/01
Date Created: 08/23/01
Do you wish to update the SC User FPROM (yes/no)? y
Update SC at SC1, FPROM 0 :
Erasing...
Done.
Writing and verifying ...
Done.
xc46-sc1:sms-svc:20> /opt/SUNWSMS/bin/flashupdate -f
/opt/SUNWSMS/firmware/nSSCPOST.di SC1/FP1*
Current SC FPROM Information
============================
ERROR: Invalid FPROM segment at offset 0.
SC Flash Image Information
==========================
Name: ExtPOST, Version: 1.15
Size: 207161, Check Sum: 62276
Date Flashed: 08/23/01
Date Created: 08/23/01
Do you wish to update the SC User FPROM (yes/no)? yes
Update SC at SC1, FPROM 1 :
Erasing...
   Done.
   Writing and verifying ...
  Done

8. Shutdown the SC, but do not reboot.

9. At OBP, set and/or verify the following OBP parameters:

ok setenv pcib-probe-list 1,2,3
ok auto-boot? false

10. Copy any devalias entries you wish to keep. THEY WILL GET ERASED!

11. Issue a "reset-all"

12. Verify dropins (Version numbers as of 12/10/01):

ok show-dropins
Dropins for Flash device: /pci@1f,0/pci@1,1/ebus@1/flashprom@10,0
-----------------------------------------------------------------------
Dropin name      Size  Checksum  Date        Date       Version  Vendor
created     flashed
-----------------------------------------------------------------------
OBP              413fc    f602   02/07/2001              3.14.6
keyboards          bf0    dd75
fonts              af6    6b86
obdiag            bd60    ad05
upa-pci           485a    3c09
SUNW,ebus          662    5e30
pci1002,5654       d1c    93eb
pci1002,4755       ff2    3d9d
pci1002,4750      1a40    b908
class060400        500    1389
class060940        99c    3f94
pci108e,1001      32a4    d714
pci1000,3         2808    d1d9
class010100       1196    703f
SUNW,floppy        c04    477b
SUNW,ttya          9cc    42f6
SUNW,ttyb          9ce    1250
SUNW,ttyse         934    d761
SUNW,ps2kb        12ae    c775
SUNW,eeprom         94    93a6
SUNW,fprom          68    e54c
SUNW,uprom1        2aa    bdec
SUNW,uprom2        2aa    bcec
SUNW,power          84    ff6e
SUNW,watchdog       68    bc7f
SUNW,enum           5c    521d
SUNW,auxio         158    3e1c
SUNW,pll            58    65ff
SUNW,7seg           60    6031
SUNW,beeper         44    a0c4
SUNW,ecpp           80    7598
ebus-i2c           59c    5fc5
i2c-8574           310    1648
i2c-8591           4d6    e979
POST             453a8    21ae   12/13/2000              1.22.0
----------------------------------------------------------------------------
PROM size = 100000 bytes    Available for Use = 3bf14 bytes
----------------------------------------------------------------------------
Dropins for Flash device: /pci@1f,0/pci@1,1/ebus@1/flashprom@10,400000
----------------------------------------------------------------------------
Dropin name      Size  Checksum  Date        Date       Version  Vendor
created     flashed
----------------------------------------------------------------------------
SSCOBP-dropins      90    ce3b   08/23/2001  08/23/2001  1.1   SUNW,sscobp
pci108e,1100       558    d103   08/23/2001  08/23/2001  0.5   SUNW,ebus
pci108e,c416       478    ce57   08/23/2001  08/23/2001  0.2   SUNW,sbbc
pci108e,1101       184    ca4a   08/23/2001  08/23/2001  0.1   SUNW,ethernet
probe+             28c    d41d   08/23/2001  08/23/2001  0.3   SUNW,probe+
interrupt-fix      558    2134   08/23/2001  08/23/2001  0.2   SUNW,int_fix
----------------------------------------------------------------------------
PROM size = 200000 bytes    Available for Use = 1feb78 bytes
----------------------------------------------------------------------------
Dropins for Flash device: /pci@1f,0/pci@1,1/ebus@1/flashprom@10,800000
----------------------------------------------------------------------------
Dropin name      Size  Checksum  Date        Date       Version  Vendor
created     flashed
----------------------------------------------------------------------------
ExtPOST          32939    f344   08/23/2001  08/23/2001 1.15   SUNW,ssc-diag-le
diag-levels        f43    96dc   08/23/2001  08/23/2001 1.15   SUNW,ssc-diag-le
----------------------------------------------------------------------------
PROM size = 200000 bytes    Available for Use = 1cc740 bytes
----------------------------------------------------------------------------

13. At OBP:

ok setenv post-on-sir? true
ok setenv diag-level pmax-epvmax
ok setenv diag-switch? true
ok setenv auto-boot? true
ok setenv boot-device XXXXXXXXXX (whatever is appropriate)
ok setenv diag-device XXXXXXXXXX (whatever is appropriate)

NOTE: In most cases, boot-device and diag-device should be the same. In the case of properly configured Sun Fire 15K Nordica, on a reboot of the SC, the diag-device is booted, not the boot-device.

14. Set any OBP aliases that were lost.

15. Issue a "reset-all"

16. Insure SSCPOST was successful.

  xc3p11-sc0:sms-svc:21> prtconf -pv | grep POST
ssc-post-results:  'CP1500 POST Passed; SSC POST v1.15 Passed'

17. After the automatic boot to Solaris, verify SMS started:

xc46-sc1:sms-svc:3> prtconf -V
OBP 3.14.6 2001/02/07 14:48
xc46-sc1:sms-svc:4> pgrep hwad
369
xc46-sc1:sms-svc:5> showfailover -r
SPARE

Modification History
Date: 14-NOV-2003
  • Minor update on 'step 6' of the Corrective Action section.
  • Added the Sun Fire 12K platform.
  • "IMPORTANT NOTE FOR SITES RUNNING SMS 1.3" section in #6 of Corrective Action section has been modified.

Date: 08-DEC-2003
  • Update to reflect an availability of the CP2140 patches as of November 14th.

Date: 06-FEB-2004
  • Change 12000/15000 to 12K/15K on the Systems Affected Section.
  • Corrected URL address on the Reference Section.
  • Removed Infodoc from the Reference Section.
  • Minor update on the patch related issues on Corrective Action section.
  • Added a f/w availability description on Comment Section.

Date: 16-JUN-2004
  • Updated Step 2. No firmware other than that provided by the Nordica script is acceptable.

Date: 10-AUG-2005
  • Added new issue to Issue description
  • Added new step to check CP1500 OBP settings

Date: 21-JUL-2006
  • Updated the resolution section to resolve a step issue.

 



Previously Published As
100272
Internal Comments


The correct firmware is only available in the tar file. The current version is 3.14.6. The following patches should NOT be used on a Nordica for use in a System controller CPU board: 115951-01, 108673-02.



The string to identify a properly patched CP1500 is "SUNW,UltraSPARC-IIi-cEngine", this can be verified with "prtconf -vp". The current version is 3.14.6. This can be verified with "prtconf -V".



The to-be-released CP2140 Othello+ System controller CPU board will have it's own firmware. Details on this firmware, and supported configurations will be made available when Othello+ will be released.


Related Information
  • Manual: 806-3512-10: Sun Fire 15K System Service Manual
  • URL: http://pts-americas.west/esg/hsg/starcat/patches/Nordia-update-current.tar.Z

Internal Contributor/submitter
Rene Fennet

Internal Eng Business Unit Group
KE Authors

Internal Eng Responsible Engineer
Rene Fennet

Internal Kasp FAB Legacy ID
100272, I0761-1 (FIN)

Internal Sun Alert & FAB Admin Info
Critical Category:
Significant Change Date:
Avoidance: Patch
Responsible Manager: null
Original Admin Info: null

Product_uuid
077fd4c5-df8f-4320-ad69-7d01603a674d|Sun Fire 12K Server
29e4659c-0a18-11d6-9fa1-e67bbc033df8|Sun Fire 15K Server

Attachments
This solution has no attachment
  Copyright © 2011 Sun Microsystems, Inc.  All rights reserved.
 Feedback