Document Audience:INTERNAL
Document ID:I1009-2
Title:During power on (cold boot) of a Sun StorEdge 6020/6120 Array or Sun StorEdge 6320 system one or more drives may come up in an offline state.
Copyright Notice:Copyright © 2005 Sun Microsystems, Inc. All Rights Reserved
Update Date:2003-09-30

----------------------------------------------------------------
             - Sun Proprietary/Confidential: Internal Use Only -
----------------------------------------------------------------------------
                          FIELD INFORMATION NOTICE
            (For Authorized Distribution by Enterprise Services)
FIN #: I1009-2                                           Date: Sep/04/03
Synopsis: During power on (cold boot) of a Sun StorEdge 6020/6120 Array or Sun StorEdge 6320 system one or more drives may come up in an offline state.
SunAlert: No
Top FIN/FCO Report: Yes
Products Reference: Sun StorEdge 6020/6120/6320
Product Category: Storage / Service
Product Affected: 
Systems Affected:
------- --------
Mkt_ID   Platform   Model   Description                    Serial Number
------   --------   -----   -----------                    -------------
  -       SE6320      -     Sun StorEdge 6320 System             -


X-Options Affected
--------- -------
Mkt_ID   Platform   Model   Description               Serial Number
------   --------   -----   -----------               -------------
  -       SE6020     ALL    Sun StorEdge 6020 Array         -
  -       SE6120     ALL    Sun StorEdge 6120 Array         -
Parts Affected: 
----------------------
Part Number    Description         Model
-----------    -----------         -----
     -              -                -
References: 
BugID:   4899514 - 6120: Drives marked offline when systems are powered 
                   up in 2x4 and 2x6.
                   
PatchID: 114285-07
PatchID: 114950-02
PatchID: 114591-13               
                   
URL:
  http://edist.central/edist-cgi/showtool.cgi?tool=Sun+StorEdge+6120&version=1.1
  http://edist.central/edist-cgi/showtool.cgi?tool=Sun+StorEdge+6320+System&version=1.1
  http://sdpsweb.central/FIN_FCO/FIN/FINI1009-2_dir/CustomerList.sxc
  http://sdpsweb.central/FIN_FCO/FIN/FINI1009-1_dir/CustomerLetter.sxw
Issue Description: 
Change History 
--------------
I1009-2

 Date Modified: Sep/04/2003
 Updates: REFERENCES, PROBLEM DESCRIPTION, CORRECTIVE ACTION
 . REFERENCES: updated URLs where to find CD image and recovery procedures,
 		added SunSolve URL
 . PROBLEM DESCRIPTION: updated URLs where to find CD image and recovery
 		procedures, clarified wording in this section
 . CORRECTIVE ACTION: updated URLs where to find CD image and recovery
 		procedures
 
--------------

The Sun StorEdge 6020, 6120 Array and the Sun StorEdge 6320 system may
exhibit a behavior where during power on (cold boot), one or more
drives may come up in an offline state.  Cold system boot is the only
way this issue has been observed.

Occurrence of this behavior is random and dependent on communication
timing between the drives and controller at power up.  The probability 
of occurrence of this behavior manifesting itself in the field varies 
upon configuration and RAID setting.  The probability is lower for 
the tray level (less than 1%), whereas it's somewhat higher with rack 
configurations (2-5%).

This behavior may result in system/data unavailability.  If the
customer powers the product(s) down completely and then powers it back
up, one or more drives may be offline.  If the customer takes NO
remedial actions (eg. reseat drives), there is no impact to system/data
availability.  

If a single drive comes up in an offline state, a drive reconstruction
will commence with the offline drive.  If two or more drives come up in 
an offline state, this could result in system/data unavailability.  
If the customer takes no remedial actions (eg.  reseat drives), the 
system/data are recoverable. 
             
If a customer experiences this behavior (eg. one or more drives are
offline), they should contact their Sun representative who in turn can
go to the following website(s) to implement a recovery process to bring
the drives back online.  These websites are unique for each products,
SE6120 and SE6320.  If the recovery procedure is invoked, check this
mandatory FIN for updates to any further required activity.


** CAUTION!  If the customer does take remedial action, such as
             reseating drives, this can result in data loss.  
         
To recover, the the procedures found at the below URL must be followed:

For an SE6120:

  http://edist.central/edist-cgi/showtool.cgi?tool=Sun+StorEdge+6120&version=1.1
  
This site contains the SE6120 FW patch (.tar file) and installation/
recovery instructions.  
     
For an SE6320:

  http://edist.central/edist-cgi/showtool.cgi?tool=Sun+StorEdge+6320+System&version=1.1
  
This site contains a complete SP baseline CD image (.tar file) and 
installation/recovery instructions.  This CD image is provided for those 
customers who cannot upgrade their SE6320 directly off the internet.  

All StorEdge 6120/6020 Arrays, and all StorEdge 6320 systems below
firmware 3.0.6 are at risk.

To help identify and communicate to affected customers, a customer
list and customer letter are provided below.

  http://sdpsweb.central/FIN_FCO/FIN/FINI1009-2_dir/CustomerList.sxc
 
  http://sdpsweb.central/FIN_FCO/FIN/FINI1009-1_dir/CustomerLetter.sxw

The solution for this issue is a firmware update to the storage trays.
This firmware update is provided in v3.0.6.  The firmware upgrade is
available free of charge and coupled with free installation by Sun
Services.  In addition to making the firmware upgrade, it is strongly
recommended to the Sun Services representatives that they take
advantage of the opportunity to reiterate the value of SSRR to the
customer, and ask again if they would like to have it implemented.

The fix for this issue is included in 6120 firmware patch 114285-07.
This patch is part of a larger SE6120/6320 baseline upgrade referred to
internally as MIRE1.1.  MIRE1.1 includes a total of (8) patches for
each of the other SE6120/6320 components.  

For the SE6120, the following patch is mandatory and can be found on SunSolve:

 114285-07   SE6120 Firmware

For SE6120 customers using Sun StorEdge Configurations Services and/or StorADE,
it is strongly recommended that the following patches also be installed:

 114950-02   Configuration Services  (if the customer is using conf services)
 114591-13   StorADE SUNWstade Support Patch (if customer is using StorADE)

For the 6320, the entire MIRE 1.1 patch set is mandatory for this upgrade.

In addition to the patch set being available on SunSolve.Central and
patchpro.sun.com, a CD image is also available on edist.central.  This
CD Image contains the complete MIRE 1.1 patch set including the
114285-07 firmware patch.  Instructions on how to use this CD image are
included in the "Instructions" file accompanying the CD or patch .tar
files.

For a SE6120, go to:

  http://edist.central/edist-cgi/showtool.cgi?tool=Sun+StorEdge+6120&version=1.1

For a SE6320, go to:

  http://edist.central/edist-cgi/showtool.cgi?tool=Sun+StorEdge+6320+System&version=1.1
Implementation: 
---
        | X |   MANDATORY (Fully Proactive)
         ---    
         
  
         ---
        |   |   CONTROLLED PROACTIVE (per Sun Geo Plan) 
         --- 
         
                                
         ---
        |   |   REACTIVE (As Required)
         ---
Corrective Action: 
Proactively install patches as outlined above.

Until then please follow the below recommendation.

For customers already in production with these products, it is strongly
recommended to not power them down unless absolutely necessary until
the patch upgrade is complete.  If customers have not yet put these
products into production, it is recommended that they are upgraded
before going into production if possible.

Resources are being put in place to insure the upgrade process is easy,
fast, and made in such a way that customers understand that Sun's
number one priority is quality and system/data availability.


NOTE:

The patch CD archive was re-released on August 19, 2003.  If you have
taken a copy of the archive before this date, or received an actual CD
with the patches, please DO NOT use it.  To verify you have the correct
version, please check the README that accompanies the archive.  It
should contain:

    Baseline 1.1
    Revision 3

If you have used the previous CD image/archive, all the patches in the
baseline would have been successfully installed.  However, the arrays
would not have been upgraded with the latest firmware.  This is easily
fixed by logging into the arrays and manually upgrading using the
controller/loopcard firmware.

    To install the controller firmware, from the 6120 command line, type
    the following to install the level 2 and 3 firmware code:

       :/:<7>ep download t4l3_306.bin
       :/:<7>ep download t4l2_306.bin

    To install the loopcard firmware, upgrade all loop cards in the partner
    group as follows from the 6120 command line:

        :/:<1>lpc version
                       LOOP A          LOOP B
        Enclosure  1   6.27            6.27
        Enclosure  2   6.27            6.27

        :/:<2>lpc download u1l1 lpc14_6.29.bin

    Repeat the above steps for all units in the partner group (ie u2l1
    and u2l2).

        :/:<3>lpc download u1l2 lpc14_6.29.bin
        :/:<4>lpc download u2l1 lpc14_6.29.bin
        :/:<5>lpc download u2l2 lpc14_6.29.bin

    Reboot the loopcards for the upgrade to take effect:

            :/:<6>lpc reboot u1l1

    Repeat the above for all other loopcards

You can also see the complete recovery procedures via the edist.central
websites identified above.
Comments: 
Until patch 114285-07 is installed, customers should be cautioned to
avoid cold boots.  Drives appearing offline will not occur in a fully
operating system if a cold boot is not executed.  If the customer
experiences this behavior during a cold boot of more than one drive
coming up offline, they should be instructed to notify their Sun
account team to initiate corrective action immediately.

Failure to follow this procedure could result in the necessity of
restoring data from a backup.

============================================================================
Implementation Footnote: 
i)   In case of MANDATORY FINs, Sun Services will attempt to contact
     all affected customers to recommend implementation of the FIN.

ii)  For CONTROLLED PROACTIVE FINs, Sun Services mission critical
     support teams will recommend implementation of the FIN  (to their
     respective accounts), at the convenience of the customer.

iii) For REACTIVE FINs, Sun Services will implement the FIN as the
     need arises.
----------------------------------------------------------------------------
All released FINs and FCOs can be accessed using your favorite network
browser as follows:

SunWeb Access:
--------------
* Access the top level URL of http://sdpsweb.Central/FIN_FCO/

* From there, select the appropriate link to query or browse the FIN and
  FCO Homepage collections.

SunSolve Online Access:
-----------------------
* Access the SunSolve Online URL at http://sunsolve.Central/

* From there, select the appropriate link to browse the FIN or FCO index.

Internet Access:
----------------
* Access the top level URL of  https://spe.sun.com
--------------------------------------------------------------------------
General:
--------
* Send questions or comments to [email protected]
---------------------------------------------------------------------------
Statusactive