| Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback |
| Sun System Handbook - ISO 3.4 June 2011 Internal/Partner Edition | ||
|
|
||
 |
||||||||||||
Solution Type Technical Instruction Sure Solution 1012472.1 : Effects of the sccli set inter-controller-link / icl command on Sun StorEdge[TM] 3511
PreviouslyPublishedAs 217185 Description This article shows the effects of the set icl command on a Sun StorEdge[TM] 3511 (SE3511). The effects are shown for both FC-Loop connections and Point-To-Point connections. HW used: SE3511, V880 with 2 HBA's, Brocade 3850 Commands used: sccli, luxadm Steps to Follow 1. HW configuration: ==================== 1.1 FC Loop Configuration ========================= SE3511 channel 4 upper connected to HBA1 host1 SE3511 channel 4 lower connected to HBA2 host1 SE3511 channel 4 PID[Lower] 44 and SID [Upper] 45 Effects of the set icl command to the HBA's on the loop. ======================================================== sccli> show redu Primary controller serial number: 8023714 Primary controller location: Lower Redundancy mode: Active-Active Redundancy status: Enabled Secondary controller serial number: 8023559 sccli> show chan Ch Type Media Speed Width PID / SID -------------------------------------------- 0 Host FC(P) 2G Serial 44 / N/A 1 Host FC(P) N/A Serial N/A / 42 2 Drive FC(L) 2G Serial 14 / 15 3 Drive FC(L) 2G Serial 14 / 15 4 Host FC(P) 2G Serial 44 / 45 5 Host FC(P) N/A Serial N/A / 46 6 Host LAN N/A Serial N/A / N/A sccli> show lun-maps Ch Tgt LUN ld/lv ID-Partition Assigned Filter Map --------------------------------------------------------------------- 0 44 0 ld0 1AE0FCA4-02 Primary 1 42 0 ld1 377EA15F-00 Secondary 4 44 0 ld0 1AE0FCA4-02 Primary 4 45 0 ld1 377EA15F-00 Secondary 5 46 0 ld1 377EA15F-00 Secondary All channels connected: ----------------------- sccli> show inter inter-controller-link upper channel 0: connected inter-controller-link lower channel 0: connected inter-controller-link upper channel 1: connected inter-controller-link lower channel 1: connected inter-controller-link upper channel 4: connected inter-controller-link lower channel 4: connected inter-controller-link upper channel 5: connected inter-controller-link lower channel 5: connected # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl Pos AL_PA ID Hard_Addr Port WWN Node WWN Type 0 1 7d 0 210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter) 1 9f 2c 9f 256000c0ffc0660d 206000c0ff00660d 0x0 (Disk device) [lower] 2 2 7c 0 210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type) 3 9e 2d 9e 256000c0ffd0660d 206000c0ff00660d 0x0 (Disk device) [upper] # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl Pos AL_PA ID Hard_Addr Port WWN Node WWN Type 0 1 7d 0 210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type) 1 9f 2c 9f 256000c0ffc0660d 206000c0ff00660d 0x0 (Disk device) 2 2 7c 0 210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter) 3 9e 2d 9e 256000c0ffd0660d 206000c0ff00660d 0x0 (Disk device) ==> with icl chan 4 upper and lower connected one FC-Loop with 4 nodes is formed. The HBA's see each other and the 2 mapped lun's. Upper Channel 4 disconnected: ----------------------------- sccli> show inter inter-controller-link upper channel 0: connected inter-controller-link lower channel 0: connected inter-controller-link upper channel 1: connected inter-controller-link lower channel 1: connected inter-controller-link upper channel 4: disconnected inter-controller-link lower channel 4: connected inter-controller-link upper channel 5: connected inter-controller-link lower channel 5: connected # luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl # luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl Pos AL_PA ID Hard_Addr Port WWN Node WWN Type 0 1 7d 0 210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter) 1 9e 2d 9e 256000c0ffd0660d 206000c0ff00660d 0x0 (Disk device) [upper] # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl No devices are found on /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl. ==> with icl chan 4 upper disconnected only one FC-Loop with 2 nodes has been formed for the upper controller. The HBA connected to the upper SFP has access to the lun mapped to the upper controller. Upper and lower Channel 4 disconnected: --------------------------------------- sccli> show inter inter-controller-link upper channel 0: connected inter-controller-link lower channel 0: connected inter-controller-link upper channel 1: connected inter-controller-link lower channel 1: connected inter-controller-link upper channel 4: disconnected inter-controller-link lower channel 4: disconnected inter-controller-link upper channel 5: connected inter-controller-link lower channel 5: connected # luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl # luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl Pos AL_PA ID Hard_Addr Port WWN Node WWN Type 0 1 7d 0 210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter) 1 9e 2d 9e 256000c0ffd0660d 206000c0ff00660d 0x0 (Disk device) [upper] # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl Pos AL_PA ID Hard_Addr Port WWN Node WWN Type 0 1 7d 0 210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter) 1 9f 2c 9f 256000c0ffc0660d 206000c0ff00660d 0x0 (Disk device) [lower] ==> with icl chan 4 upper and lower disconnected 2 independent FC-Loops with 2 nodes each have been formed. The HBA connected to the upper SFP has access to the lun mapped to the upper controller. The HBA connected to the lower SFP has access to the lun mapped to the lower controller. Lower Channel 4 disconnected: ----------------------------- sccli> show inter inter-controller-link upper channel 0: connected inter-controller-link lower channel 0: connected inter-controller-link upper channel 1: connected inter-controller-link lower channel 1: connected inter-controller-link upper channel 4: connected inter-controller-link lower channel 4: disconnected inter-controller-link upper channel 5: connected inter-controller-link lower channel 5: connected # luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl # luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl No devices are found on /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl. # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl Pos AL_PA ID Hard_Addr Port WWN Node WWN Type 0 1 7d 0 210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter) 1 9f 2c 9f 256000c0ffc0660d 206000c0ff00660d 0x0 (Disk device) [lower] ==> with icl chan 4 lower disconnected only one FC-Loop with 2 nodes has been formed for the lower controller. The HBA connected to the lower SFP has access to the lun mapped to the lower controller. 1.2 Switch Configuration ======================== Brocade 3850 switch Zone A: port 0 : SE3511 channlel 4 upper, p2p port 3 : hba1, p2p Zone B: port 8 : SE3511 channlel 4 lower, p2p port 0xb: hba2, p2p sccli> show redu Primary controller serial number: 8023714 Primary controller location: Lower Redundancy mode: Active-Active Redundancy status: Enabled Secondary controller serial number: 8023559 sccli> show chan Ch Type Media Speed Width PID / SID -------------------------------------------- 0 Host FC(P) N/A Serial 44 / N/A 1 Host FC(P) N/A Serial N/A / 42 2 Drive FC(L) 2G Serial 14 / 15 3 Drive FC(L) 2G Serial 14 / 15 4 Host FC(P) 2G Serial 44 / 45 5 Host FC(P) N/A Serial N/A / 46 6 Host LAN N/A Serial N/A / N/A sccli> show host max-luns-per-id: 32 queue-depth: 1024 fibre-connection-mode: point-to-point inband-management: enabled Upper and lower channel 4 disconnected: --------------------------------------- sccli> show inter inter-controller-link upper channel 0: connected inter-controller-link lower channel 0: connected inter-controller-link upper channel 1: connected inter-controller-link lower channel 1: connected inter-controller-link upper channel 4: disconnected inter-controller-link lower channel 4: disconnected inter-controller-link upper channel 5: connected inter-controller-link lower channel 5: connected # luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl # luxadm -e forcelip /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl Pos Port_ID Hard_Addr Port WWN Node WWN Type 0 10000 0 256000c0ffd0660d 206000c0ff00660d 0x0 (Disk device) 1 10300 0 210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter) # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl Pos Port_ID Hard_Addr Port WWN Node WWN Type 0 10800 0 256000c0ffc0660d 206000c0ff00660d 0x0 (Disk device) 1 10b00 0 210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter) ==> with both icl's disconnected both controllers establish a p2p connection to the switch. Each HBA can access the lun in its zone. Lower Channel 4 disconnected: ----------------------------- sccli> show inter inter-controller-link upper channel 0: connected inter-controller-link lower channel 0: connected inter-controller-link upper channel 1: connected inter-controller-link lower channel 1: connected inter-controller-link upper channel 4: connected inter-controller-link lower channel 4: disconnected inter-controller-link upper channel 5: connected inter-controller-link lower channel 5: connected # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl No devices are found on /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl. # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl Pos Port_ID Hard_Addr Port WWN Node WWN Type 0 10800 0 256000c0ffc0660d 206000c0ff00660d 0x0 (Disk device) 1 10b00 0 210000e08b0c8019 200000e08b0c8019 0x1f (Unknown Type,Host Bus Adapter) ==> with icl channel 4 lower disconnected only the lower controller is able to establish a p2p connection to the switch. Only the HBA in the same zone as the lower controller has access to the lun mapped to the lower controller All channels connected: ----------------------- sccli> show inter inter-controller-link upper channel 0: connected inter-controller-link lower channel 0: connected inter-controller-link upper channel 1: connected inter-controller-link lower channel 1: connected inter-controller-link upper channel 4: connected inter-controller-link lower channel 4: connected inter-controller-link upper channel 5: connected inter-controller-link lower channel 5: connected # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl No devices are found on /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl. # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl No devices are found on /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl. ==> with channel 4 upper and lower connected none of the controllers is able to establish a p2p connection to the switch. Both HBA's are unable to access a lun. Upper channel 4 disconnected: ----------------------------- sccli> show inter inter-controller-link upper channel 0: connected inter-controller-link lower channel 0: connected inter-controller-link upper channel 1: connected inter-controller-link lower channel 1: connected inter-controller-link upper channel 4: disconnected inter-controller-link lower channel 4: connected inter-controller-link upper channel 5: connected inter-controller-link lower channel 5: connected # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@3/fp@0,0:devctl Pos Port_ID Hard_Addr Port WWN Node WWN Type 0 10000 0 256000c0ffd0660d 206000c0ff00660d 0x0 (Disk device) 1 10300 0 210000e08b0c9919 200000e08b0c9919 0x1f (Unknown Type,Host Bus Adapter) # luxadm -e dump_map /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl No devices are found on /devices/pci@8,700000/SUNW,qlc@4/fp@0,0:devctl. ==> with icl channel 4 upper disconnected only the upper controller is able to establish a p2p connection to the switch. Only the HBA in the same zone as the upper controller has access to the lun mapped to the upper controller Conclusion: ----------- In a loop configuration we can have following configurations: * common loop with both controllers on the same loop * two independant loops if both icl disconnected for a channel * one loop with one controller active which has the icl disconnected In p2p configuration we can have following configurations: * two independant controllers both with disconnected icl * one active controller with icl disconnected Note: With both icl connected and p2p no controller will connect to the switch as only two devices are allowed in a p2p configuration. Product Sun StorageTek 3511 SATA Array SE3511, FC-Loop, Point-To-Ppoint, SAN, switch, FC-Topology, ICL, inter-controller-link, minnow Previously Published As 83411 Change History Date: 2005-12-22 User Name: 71396 Action: Approved Comment: Performed final review of article. Updated product name. Updated trademarking. Changed audience from free to contract per fvf. Publishing. Version: 3 Date: 2005-12-22 User Name: 71396 Action: Accept Comment: Version: 0 Product_uuid 9fdbb196-73a6-11d8-9e3a-080020a9ed93|Sun StorageTek 3511 SATA Array Attachments This solution has no attachment |
||||||||||||
|
||||||||||||