List Flash Storage on Exadata Servers

You can query SCSI flash device information using lsscsi or list your PCI flash module using flash_dom to understand how flash storage is configured and presented on an Exadata Storage Server

lsscsi -v | grep MARVEL

Note:  Flash devices are show four 8, 9, 10, 11.  This is because of four flash cards have four FMods.  Therefore there are 16 flash devices and you can use flash_dom to display the details for the PCI flash devices

flash_dom –l

HBA# Port Name         Chip Vendor/Type/Rev    MPT Rev  Firmware Rev  IOC     WWID                 Serial Number

1.  /proc/mpt/ioc0    LSI Logic SAS1068E C0     105      011b5c00     0       50310020001116a80     465769T+1209A4ADFA

        Current active firmware version is 011b5c00 (1.27.92)

        Firmware image's version is MPTFW-01.27.92.00-IT

        x86 BIOS image's version is MPTBIOS-6.26.00.00 (2008.10.14)

        FCode image's version is MPT SAS FCode Version 1.00.49 (2007.09.21)

          D#  B___T  Type       Vendor   Product          Rev    Operating System Device Name

          1.  0   0  Disk       ATA      MARVELLXXXXXXXD21Y   /dev/sdn    [8:0:0:0]

          2.  0   1  Disk       ATA      MARVELLXXXXXXXD21Y   /dev/sdo    [8:0:1:0]

          3.  0   2  Disk       ATA      MARVELLXXXXXXXD21Y   /dev/sdp    [8:0:2:0]

          4.  0   3  Disk       ATA      MARVELLXXXXXXXD21Y   /dev/sdq    [8:0:3:0]

Validate FMods

You can see the flash devices grouped into sets of four on PCI slots 1, 2, 4, 5.  Each device per PCI slot residing in FDOM 0, 1, 2,OR 3.  Each FMOD is 24GB slide of storage x 16 = 284GB.  In X2 models, there are 4x 96GB pci FLASH cards per storage cell.  Each PCI flash car has a dvice partitioned per FDOM so there are 16 flash devices.  These flash devices  are the flash disks and used for Smart flash cache and smart flash logging. 

You should see 16 FMODs.  To validate all FMODs are present at the OS level, you can perform the following steps:

cellcli > list physicaldisk where disktype='FlashDisk' attributes name, disktype, physicalSize, slotNumber

flash_dom –l

cellcli > list flashcache detail

         id:                     cf20a022-a381-428e-bf6f-ee54dbcdcb56

         size:                   364.75G

         status:                 normal

cellcli > list flashlog detail

id:                     e7cbe8c7-d2f3-4d01-9f87-da83861c21d1

         size:                   512M

         status:                 normal

To verify hardware profile

/opt/oracle.SupportTools/CheckHWnFWProfile -d