Sun Microsystems, Inc.  Sun System Handbook - ISO 3.4 June 2011 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1005034.1
Update Date:2009-03-03
Keywords:

Solution Type  Technical Instruction Sure

Solution  1005034.1 :   Understanding the "show loop-map" output for the Sun StorEdge[TM] 3510  


Related Items
  • Sun Storage 3510 FC Array
  •  
Related Categories
  • GCS>Sun Microsystems>Storage - Disk>Modular Disk - 3xxx Arrays
  •  

PreviouslyPublishedAs
207084


Description
The show loop-map command can be used to examine the health of any back end disk loop on the Sun StorEdge[TM] 3510. Disk loops can be examined individually and compared against each other to discover problems.

In addition, the location (top slot  vs. bottom slot) of the Primary RAID Controller, the Chassis ID setting of the RAID chassis (and all JBOD chassis'), and the exact cabling configuration can be determined using the "show loop-map" output.



Steps to Follow
Several things must be understood before an accurate analysis can be made:

1. The show loop-map command output is always displayed from the perspective of the Primary RAID Controller, whether it's in the top or bottom slot.

2. When the RAID Controller in the top slot examines the loop map for channel 2 (also in the top slot), the listed devices will be in a different order than when it examines channel 3 (which is in the bottom slot).

-- The same is true for the RAID Controller in the bottom slot.

3. When the loop map output reaches an SFP port connection, and no connection exists (or is not functioning), nothing will be shown in the output for that SFP port.

4. When the loop map output reaches an SFP port connection, and a connection to an expansion JBOD exists, the loop map jumps to the JBOD at that point in the output.

-- If another JBOD is connected to the first JBOD, when the loop map reaches that SFP port connection it jumps to the second JBOD.

-- Once the last expansion JBOD is reached, the loop map shows that entire chassis, then completes the previous JBODs, in reverse order, until it returns to    the original SFP port connection in the RAID chassis.

5. If Chassis IDs are duplicated on any chassis in the configuration, the show loop-map is nearly useless because some loop IDs will be assigned correctly and some will be assigned randomly and every time the array is power cycled, the loop ID assignments will likely change.

6. NEVER, EVER assume the RAID chassis is set to Chassis ID 0!

Some of the many things that can be determined using the show loop-map command:

1. Location of the Primary RAID Controller:

    -- If  the Primary RAID Controller is in the top slot, the first RAID Controller listed in the output will show 14 in the SEL_ID column.

    -- If  the Primary RAID Controller is in the bottom slot, the first RAID Controller listed in the output will show 15 in the SEL_ID column.

2. The Chassis ID setting for the RAID chassis:

    -- If the Primary RAID Controller is in the top slot  and  show loop-map channel 2  is run   - or -

    -- if the Primary RAID Controller is in the bottom slot  and  show loop-map channel 3  is run:

    -- Then the ENCL_ID listed for the very last SES device in the output is the Chassis ID setting for the RAID chassis .

3. The exact cabling configuration of a loop, including which SFP ports (left vs. right) are being used on each chassis.

4. A generalized initial analysis can be made by comparing the number of  devices found in loop map  on each channel as well as the number of devices actually installed (total number of disks  + one or two RAID Controllers  +  an SES device for every chassis on the loop).

NOTE : Before analyzing the show loop-map command output, first determine which slot the Primary RAID Controller is in using the guidelines in item 1. above.

There are two different orders in which the devices in the RAID chassis will appear:

1. If:

-- the Primary RAID Controller is in the top slot and  show loop-map channel 2  is run  

- or -

-- the Primary RAID Controller is in the bottom slot and  show loop-map channel 3  is run:

The order the devices should appear in is:


Primary RAID Controller
 (which is in same slot as the channel specified in the command)

Right SFP port
 (one or more devices may be listed if JBODs are attached. See the JBOD loop maps below.)
Disk in RAID chassis, 
slot 1

Disk in RAID chassis, s
lot 4

Disk in RAID chassis, 
slot 2

Disk in RAID chassis, 
slot 3

Disk in RAID chassis, 
slot 5

Disk in RAID chassis, 
slot 0

Disk in RAID chassis, 
slot 8

Disk in RAID chassis, 
slot 9


Secondary RAID Controller
 (which is in opposite slot as the channel specified in the command).

Left SFP port
 (one or more devices may be listed if JBODs are attached. See the JBOD loop maps below.)
Disk in RAID chassis, 
slot 11

Disk in RAID chassis, 
slot 6

Disk in RAID chassis, 
slot 10

Disk in RAID chassis, 
slot 7

RAID chassis 
SES device

2.If:

-- the Primary RAID Controller is in the top slot and  show loop-map channel 3  is run   

- or -

-- the Primary RAID Controller is in the bottom slot and  show loop-map channel 2  is run:

The order the devices should appear in is:


Primary RAID Controller
 (which is in opposite slot as the channel specified in the command).

Left SFP port
 (one or more devices may be listed if JBODs are attached. See the JBOD loop maps below.)
Disk in RAID chassis, 
slot 11

Disk in RAID chassis, 
slot 6

Disk in RAID chassis, 
slot 10

Disk in RAID chassis, 
slot 7

RAID chassis 
SES device


Secondary RAID Controller
 (which is in same slot as the channel specified in the command).

Right SFP port
 (one or more devices may be listed if JBODs are attached. See the JBOD loop maps below.)
Disk in RAID chassis, 
slot 1

Disk in RAID chassis, 
slot 4

Disk in RAID chassis, 
slot 2

Disk in RAID chassis, 
slot 3

Disk in RAID chassis, 
slot 5

Disk in RAID chassis, 
slot 0

Disk in RAID chassis, 
slot 8

Disk in RAID chassis, 
slot 9

There are two different orders in which devices in the JBOD chassis will appear:

 They are governed by which of the JBOD's SFP ports (Left or Right) the RAID chassis (or any intermediary JBODs which are eventually connected to the RAID chassis) is connected to.

1. If this JBOD is connected to the RAID chassis (or any intermediary JBODs) via it's Left SFP port, the loop map order will be:

Disk in JBOD chassis, 
slot 11

Disk in JBOD chassis, 
slot 6

Disk in JBOD chassis, 
slot 10

Disk in JBOD chassis, 
slot 7

JBOD chassis 
SES device


Right SFP port
 (one or more devices may be listed if any additional JBODs are attached at this port.)
Disk in JBOD chassis, 
slot 1

Disk in JBOD chassis, 
slot 4

Disk in JBOD chassis, 
slot 2

Disk in JBOD chassis, 
slot 3

Disk in JBOD chassis, 
slot 5

Disk in JBOD chassis, 
slot 0

Disk in JBOD chassis, 
slot 8

Disk in JBOD chassis, 
slot 9

2. If the JBOD is connected to the RAID chassis (or any intermediary JBODs) via it's Right SFP port, the loop map order will be:

Disk in JBOD chassis, 
slot 1

Disk in JBOD chassis, 
slot 4

Disk in JBOD chassis, 
slot 2

Disk in JBOD chassis, 
slot 3

Disk in JBOD chassis, 
slot 5

Disk in JBOD chassis, 
slot 0

Disk in JBOD chassis, 
slot 8

Disk in JBOD chassis, 
slot 9


Left SFP port
 (one or more devices may be listed if any additional JBODs are attached at this port.)
Disk in JBOD chassis, 
slot 11

Disk in JBOD chassis, 
slot 6

Disk in JBOD chassis, 
slot 10

Disk in JBOD chassis, 
slot 7

JBOD chassis 
SES device

The following two examples show a fully populated RAID chassis connected to a fully populated  JBOD.

sccli>  show loop-map channel 2
28 devices found in loop map
=== Channel Loop Map retrieved from CH 2 ID 12 ===
AL_PA   SEL_ID  SEL_ID  TYPE    ENCL_ID SLOT
(hex)   (hex)   (dec)
-----   -----   -----   ----    ------  ----
D1      0E      14      RAID    N/A     N/A




     SEL_ID(dec)  14  =  Primary RAID Controller in top slot.


E8      01      1       DISK    0       1    

     RAID Right-SFP not connected to anything  (ENCL_ID is 0 for the

 




E1      04      4       DISK    0       4

     

 

             RAID chassis, as per output above).


E4      02      2       DISK    0       2
E2      03      3       DISK    0       3
E0      05      5       DISK    0       5
EF      00      0       DISK    0       0
D9      08      8       DISK    0       8
D6      09      9       DISK    0       9
CE      0F      15      RAID    N/A     N/A
B9      1B      27      DISK    1       11   

     RAID Left-SFP connected to JBOD Left-SFP (ENCL_ID 1 is


C6      16      22      DISK    1       6

          

 

JBOD chassis, see JBOD device ordering).







BA      1A      26      DISK    1       10
C5      17      23      DISK    1       7
B6      1C      28      SES     1       N/A
CC      11      17      DISK    1       1    

     JBOD Right-SFP not connected to anything (ENCL_ID remains the same).


C9      14      20      DISK    1       4       




CB      12      18      DISK    1       2
CA      13      19      DISK    1       3
C7      15      21      DISK    1       5
CD      10      16      DISK    1       0
C3      18      24      DISK    1       8
BC
19      25      DISK    1       9
D4      0B      11      DISK    0       11   

     All attached JBODs completed, returns to RAID chassis.


DC      06      6       DISK    0       6
D5      0A      10      DISK    0       10
DA      07      7       DISK    0       7
D3      0C      12      SES     0       N/A  

     This SES indicates ENCL_ID is 0 for the RAID chassis.


sccli> show loop-map channel 3
28 devices found in loop map
=== Channel Loop Map retrieved from CH 3 ID 12 ===
AL_PA   SEL_ID  SEL_ID  TYPE    ENCL_ID SLOT
(hex)   (hex)   (dec)
-----   -----   -----   ----    ------  ----
D1      0E      14      RAID    N/A     N/A  

     SEL_ID(dec)  14  =  Primary RAID Controller in top slot.


D4      0B      11      DISK    0       11   

     RAID Left-SFP not connected to anything  (ENCL_ID is 0 for the

 


DC      06      6       DISK    0       6      

             RAID chassis, as per output above).


D5      0A      10      DISK    0       10
DA      07      7       DISK    0       7
D3      0C      12      SES     0       N/A
CE      0F      15      RAID    N/A     N/A
CC      11      17      DISK    1       1   

     RAID Right-SFP connected to JBOD Right-SFP (ENCL_ID 1 is


C9      14      20      DISK    1       4            

JBOD chassis, see JBOD device ordering).





CB      12      18      DISK    1       2
CA      13      19      DISK    1       3
C7      15      21      DISK    1       5
CD      10      16      DISK    1       0
C3      18      24      DISK    1       8
BC      19      25      DISK    1       9
B9      1B      27      DISK    1       11
 
 

     JBOD Left-SFP not connected to anything (ENCL_ID remains the same).


C6      16      22      DISK    1       6
BA      1A      26      DISK    1       10
C5      17      23      DISK    1       7
B6      1C      28      SES     1       N/A
E8      01      1       DISK    0       1    

     All attached JBODs completed, returns to RAID chassis.


E1      04      4       DISK    0       4
E4      02      2       DISK    0       2
E2      03      3       DISK    0       3
E0      05      5       DISK    0       5
EF      00      0       DISK    0       0
D9      08      8       DISK    0       8
D6      09      9       DISK    0       9


Product
Sun StorageTek 3510 FC Array

Internal Comments
This entire document is intended for internal audiences.



loop map, loop-map, 3510, fibre loop, minnow, StorEdge 3510
Previously Published As
76756

Change History
Date: 2007-12-11
User Name: 7058
Action: Approved
Comment: See previous comments.
Version: 8
Date: 2007-12-11

Attachments
This solution has no attachment
  Copyright © 2011 Sun Microsystems, Inc.  All rights reserved.
 Feedback