Sun Fire[TM] 4800, 4810, 6800, E4900, and E6900: Physical Device Mapping for 8 slot PCI+ I/O boards with XMITS

Asset ID:	1-71-1012185.1
Update Date:	2011-06-06
Keywords:

Solution Type Technical Instruction Sure

Solution 1012185.1 : Sun Fire[TM] 4800, 4810, 6800, E4900, and E6900: Physical Device Mapping for 8 slot PCI+ I/O boards with XMITS

Related Items


Sun Fire E6900 Server
 Sun Fire 6800 Server
 Sun Fire E4900 Server
 Sun Fire 4800 Server
 Sun Fire 4810 Server

Related Categories


GCS>Sun Microsystems>Servers>Midrange Servers

PreviouslyPublishedAs
216796

Description
The intention if this article is to:

Aid engineers and administrators in the identification of the correct I/O boards and slots within Sun Fire[TM] 4800, 4810, 6800, E4900, and E6900 systems with an 8 slot PCI IO board.
Help to demystify how to best lay out cards within the I/O board to maximize the number of 66MHz devices and to reduce bus contention.

Steps to Follow
The line of XMITS based I/O boards (PCI+ IB) can be installed in Sun Fire[TM] 4800, E4900, 6800, and E6900 servers.
These boards are expected to deliver a higher level of performance than original SCHIZO based PCI IB.

The PCI+ IB provides six 66MHz slots, versus the PCI IB's 2 slots.
It should be noted that the XMITS based boards remove support for the older 5 volt signaling cards.

In the new board layout, the hardware path to the XMITS ASIC and Busses A and B are the same, however, the scheme for naming the path to the specific PCI Slot scheme has changed somewhat. The same methods of calculating the position of the boards, which I/O Controller (IOC) and which BUS on the IOC remains.

eg: /ssm@0,0/pci@18,600000   ---> IO6, Bus A
      /ssm@0,0/pci@18,700000   ---> IO6, Bus B
      /ssm@0,0/pci@19,600000   ---> IO6, Bus A
      /ssm@0,0/pci@19,700000   ---> IO6, Bus B

Existing method for determining which board / ASIC / Bus remains.

To restate the procedure:

Start by breaking the hardware address down into parts

              /ssm@0,0/pci@19,700000/pci@3/SUNW,isptwo@4/sd (block)
                   ^       ^^    ^       ^
Node Id  __________|       |     |       |________ Device #
                           |     |
                     Schizo AID  |________Bus # (A=600000 or B=700000)

  To locate IO board number, divide Schizo AID by 2 and subtract 6 
  Note that the AID is in HEX.
            Hex: (19/2) - 6 = 6.5

Alternately:

            Hex 0x19 = 25
            thus        
            (25/2) - 6 = 6.5

The result tells us that the device resides on I/O boat in slot 6 (IB6).

The fact that the result has a fraction indicates that this is an odd numbered AID.

An odd AID indicates XMITS 1
An even AID indicates XMITS 0.

In the above example, it is XMITS 1.

Alternatively, one can look up the AID in the Safari AID Allocation table listed at the end of this Technical Instruction.

For the Slot Numbering, we can use the below table for the XMITS I/O boards:

   |==============================================================|
   |XMITS # | BUS    | PCI# | Physical | Capability               |
   |        |        |      |  Slot #  |                          | 
   |==============================================================|
   |    0   | 600000 |  1   |    3     | 33+66Mhz/64Bit/Long/Short|
   |    0   | 600000 |  2   |    2     | 33+66Mhz/64Bit/Long/Short|
   |    0   | 700000 |  1   |    0     | 33Mhz/64Bit/Short        |
   |    0   | 700000 |  2   |    1     | 33Mhz/64Bit/Short        |
   |    1   | 600000 |  1   |    7     | 33+66Mhz/64Bit/Long/Short|
   |    1   | 600000 |  2   |    6     | 33+66Mhz/64Bit/Long/Short|
   |    1   | 700000 |  1   |    4     | 33+66Mhz/64Bit/Long/Short|
   |    1   | 700000 |  2   |    5     | 33+66Mhz/64Bit/Long/Short|
   ===============================================================|

To draw this out logically, it looks something like this:

 pci@XX  XMITS0   __________Bus B (700000)________PCI@1   <--- Slot 0
 no remainder            |                  |
  after (XX/2)-6         |                  |_____PCI@2   <--- Slot 1
                         |
                         |__Bus A (600000)________PCI@1   <--- Slot 3
                                            |
                                            |_____PCI@2   <--- Slot 2


 pci@XX  XMITS1   __________Bus B (700000)________PCI@1   <--- Slot 4
 remainder after         |                  |
 (XX/2) - 6              |                  |_____PCI@2   <--- Slot 5
                         |
                         |__Bus A (600000)________PCI@1   <--- Slot 7
           
Sun Fire E6900 Server

Sun Fire 6800 Server

Sun Fire 4810 Server

Sun Fire 4800 Server




Internal Comments
Internal Information

The XMITS was originally planned to support 33/66 MHz PCI and 66/100 PCI-X.
At the time of writing this document, it was not known when the 100 MHz PCI-X support will be added/enabled in the I/O boards for Serengeti/Amazon.

Regardless of this current omission, the XMITS ASIC should still perform significantly faster than the SCHIZO counterpart, through increases in some of buffers 
and queues which allow for many more DMA transfers to be in flight simultaneously.

Useful Prior reading:
For some background on Sun Fire Scalable Shared Memory (SSM) and general path nomenclature, see Internal <Document: 1008674.1> .
xmits, serengeti, pci, slot, device, layout, physical, pci+

Previously Published As
76507




Attachments
This solution has no attachment