• Some users have recently had their accounts hijacked. It seems that the now defunct EVGA forums might have compromised your password there and seems many are using the same PW here. We would suggest you UPDATE YOUR PASSWORD and TURN ON 2FA for your account here to further secure it. None of the compromised accounts had 2FA turned on.
    Once you have enabled 2FA, your account will be updated soon to show a badge, letting other members know that you use 2FA to protect your account. This should be beneficial for everyone that uses FSFT.

Linux + LSI SAS + Expander

B

bexamous

[H]ard|Gawd
Joined
Dec 12, 2005
Messages
1,670
If anyone runs Linux w/LSI 1068E and uses a SAS Expander to hook up their drives, here is a simple bash script to check your storage status. Maybe one day someone will search forum and find it useful :p.

Requires smp_utils (http://sg.danny.cz/sg/smp_utils.html) and sg3_utils (check distro repo) to be installed. Its really just running this stuff and making output more readable.

It basically just prints out all the disks attached to the expander and then compares the current configuration to a 'golden' configuration. Basically when everything is how you want it you save the current configuration with '--update' and then later if a new drive shows up or disappears it will warn you. Just look at output below, its pretty simple.

Here is script:
http://dl.dropbox.com/u/15520/storage.sh

Only thing you'll need to change, is the Expander's SAS Address (this thing is unique and should always be the same no matter what system you put the SAS Expander in).

Heres one way to figure it out, the address is "5001c4500009af00"
Code: 
bexamous@nine:~/bin$ sudo find /sys/ | grep sas_device\/expander.*sas_address$
/sys/devices/pci0000:00/0000:00:1c.0/0000:04:00.0/host7/port-7:0/expander-7:0/sas_device/expander-7:0/sas_address
bexamous@nine:~/bin$ cat /sys/devices/pci0000:00/0000:00:1c.0/0000:04:00.0/host7/port-7:0/expander-7:0/sas_device/expander-7:0/sas_address
0x5001c4500009af00
bexamous@nine:~/bin$

You also have to change the Chassis information, unless you have a 4220. But likely you have hooked up your Expander differently.

Basically just look at the silk screen on the Expander and record how you're connecting things:
Code: 
chassis1bay=(
    1.4  1.5  1.6  1.7
    1.8  1.9  1.10 1.11
    1.12 1.13 1.14 1.15
    1.16 1.17 1.18 1.19
    1.20 1.21 1.22 1.23 )

You an see I pretty much connected things in order. They all start with 1 because I only have 1 SAS Expander. It is 'Expander.SilkScreenPortNumber'

Anyways... here is example what it looks like when you run:

Code: 
bexamous@nine:~/bin$ sudo ./storage.sh
+++++++++++++++++++++++++++++++++++++++++++
+++   Norco 4220                        +++
+++++++++++++++++++++++++++++++++++++++++++
[  /dev/sdc   ] [  /dev/sdd   ] [  /dev/sde   ] [  /dev/sdf   ] 
[  /dev/sdg   ] [  /dev/sdh   ] [  /dev/sdi   ] [  /dev/sdj   ] 
[             ] [             ] [             ] [             ] 
[  /dev/sdk   ] [  /dev/sdl   ] [  /dev/sdm   ] [  /dev/sdn   ] 
[             ] [             ] [             ] [             ] 


1,1  /dev/sdc scsi-SATA_WDC_WD10EADS-00_WD-WCAU46815978
2,1  /dev/sdd scsi-SATA_WDC_WD10EADS-00_WD-WCAU46783271
3,1  /dev/sde scsi-SATA_WDC_WD10EADS-00_WD-WCAU46803203
4,1  /dev/sdf scsi-SATA_WDC_WD1000FYPS-WD-WCASJ0318455
1,2  /dev/sdg scsi-SATA_WDC_WD10EACS-00_WD-WCAU42580399
2,2  /dev/sdh scsi-SATA_WDC_WD10EACS-00_WD-WCAU42557087
3,2  /dev/sdi scsi-SATA_WDC_WD10EADS-00_WD-WCAU46812587
4,2  /dev/sdj scsi-SATA_WDC_WD15EADS-00_WD-WCAUP0019266
1,3   
2,3   
3,3   
4,3   
1,4  /dev/sdk scsi-SATA_Hitachi_HDS7220_JK1130YAGVZSRT
2,4  /dev/sdl scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1361632
3,4  /dev/sdm scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1338263
4,4  /dev/sdn scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1279474
1,5   
2,5   
3,5   
4,5   



bexamous@nine:~/bin$ : drive added
bexamous@nine:~/bin$ sudo ./storage.sh
+++++++++++++++++++++++++++++++++++++++++++
+++   Norco 4220                        +++
+++++++++++++++++++++++++++++++++++++++++++
[  /dev/sdc   ] [  /dev/sdd   ] [  /dev/sde   ] [  /dev/sdf   ] 
[  /dev/sdg   ] [  /dev/sdh   ] [  /dev/sdi   ] [  /dev/sdj   ] 
[             ] [             ] [             ] [             ] 
[  /dev/sdk   ] [  /dev/sdl   ] [  /dev/sdm   ] [  /dev/sdn   ] 
[             ] [  /dev/sdo   ] [             ] [             ] 


1,1  /dev/sdc scsi-SATA_WDC_WD10EADS-00_WD-WCAU46815978
2,1  /dev/sdd scsi-SATA_WDC_WD10EADS-00_WD-WCAU46783271
3,1  /dev/sde scsi-SATA_WDC_WD10EADS-00_WD-WCAU46803203
4,1  /dev/sdf scsi-SATA_WDC_WD1000FYPS-WD-WCASJ0318455
1,2  /dev/sdg scsi-SATA_WDC_WD10EACS-00_WD-WCAU42580399
2,2  /dev/sdh scsi-SATA_WDC_WD10EACS-00_WD-WCAU42557087
3,2  /dev/sdi scsi-SATA_WDC_WD10EADS-00_WD-WCAU46812587
4,2  /dev/sdj scsi-SATA_WDC_WD15EADS-00_WD-WCAUP0019266
1,3   
2,3   
3,3   
4,3   
1,4  /dev/sdk scsi-SATA_Hitachi_HDS7220_JK1130YAGVZSRT
2,4  /dev/sdl scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1361632
3,4  /dev/sdm scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1338263
4,4  /dev/sdn scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1279474
1,5   
2,5  /dev/sdo scsi-SATA_Hitachi_HDS7220_JK1171YAH3M4HN
3,5   
4,5   


New SAS device!  It has SAS Address 5001c4500009af15.
New disk!  GUID is scsi-SATA_Hitachi_HDS7220_JK1171YAH3M4HN.
New disk added to Chassis bay 2,5; disk is /dev/sdo, GUID is scsi-SATA_Hitachi_HDS7220_JK1171YAH3M4HN.

bexamous@nine:~/bin$ 
bexamous@nine:~/bin$ 
bexamous@nine:~/bin$ sudo ./storage.sh --update
+++++++++++++++++++++++++++++++++++++++++++
+++   Norco 4220                        +++
+++++++++++++++++++++++++++++++++++++++++++
[  /dev/sdc   ] [  /dev/sdd   ] [  /dev/sde   ] [  /dev/sdf   ] 
[  /dev/sdg   ] [  /dev/sdh   ] [  /dev/sdi   ] [  /dev/sdj   ] 
[             ] [             ] [             ] [             ] 
[  /dev/sdk   ] [  /dev/sdl   ] [  /dev/sdm   ] [  /dev/sdn   ] 
[             ] [  /dev/sdo   ] [             ] [             ] 


1,1  /dev/sdc scsi-SATA_WDC_WD10EADS-00_WD-WCAU46815978
2,1  /dev/sdd scsi-SATA_WDC_WD10EADS-00_WD-WCAU46783271
3,1  /dev/sde scsi-SATA_WDC_WD10EADS-00_WD-WCAU46803203
4,1  /dev/sdf scsi-SATA_WDC_WD1000FYPS-WD-WCASJ0318455
1,2  /dev/sdg scsi-SATA_WDC_WD10EACS-00_WD-WCAU42580399
2,2  /dev/sdh scsi-SATA_WDC_WD10EACS-00_WD-WCAU42557087
3,2  /dev/sdi scsi-SATA_WDC_WD10EADS-00_WD-WCAU46812587
4,2  /dev/sdj scsi-SATA_WDC_WD15EADS-00_WD-WCAUP0019266
1,3   
2,3   
3,3   
4,3   
1,4  /dev/sdk scsi-SATA_Hitachi_HDS7220_JK1130YAGVZSRT
2,4  /dev/sdl scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1361632
3,4  /dev/sdm scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1338263
4,4  /dev/sdn scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1279474
1,5   
2,5  /dev/sdo scsi-SATA_Hitachi_HDS7220_JK1171YAH3M4HN
3,5   
4,5   


INFO:  Updating golden configuration info to current configuration.

bexamous@nine:~/bin$ sudo ./storage.sh
+++++++++++++++++++++++++++++++++++++++++++
+++   Norco 4220                        +++
+++++++++++++++++++++++++++++++++++++++++++
[  /dev/sdc   ] [  /dev/sdd   ] [  /dev/sde   ] [  /dev/sdf   ] 
[  /dev/sdg   ] [  /dev/sdh   ] [  /dev/sdi   ] [  /dev/sdj   ] 
[             ] [             ] [             ] [             ] 
[  /dev/sdk   ] [  /dev/sdl   ] [  /dev/sdm   ] [  /dev/sdn   ] 
[             ] [  /dev/sdo   ] [             ] [             ] 


1,1  /dev/sdc scsi-SATA_WDC_WD10EADS-00_WD-WCAU46815978
2,1  /dev/sdd scsi-SATA_WDC_WD10EADS-00_WD-WCAU46783271
3,1  /dev/sde scsi-SATA_WDC_WD10EADS-00_WD-WCAU46803203
4,1  /dev/sdf scsi-SATA_WDC_WD1000FYPS-WD-WCASJ0318455
1,2  /dev/sdg scsi-SATA_WDC_WD10EACS-00_WD-WCAU42580399
2,2  /dev/sdh scsi-SATA_WDC_WD10EACS-00_WD-WCAU42557087
3,2  /dev/sdi scsi-SATA_WDC_WD10EADS-00_WD-WCAU46812587
4,2  /dev/sdj scsi-SATA_WDC_WD15EADS-00_WD-WCAUP0019266
1,3   
2,3   
3,3   
4,3   
1,4  /dev/sdk scsi-SATA_Hitachi_HDS7220_JK1130YAGVZSRT
2,4  /dev/sdl scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1361632
3,4  /dev/sdm scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1338263
4,4  /dev/sdn scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1279474
1,5   
2,5  /dev/sdo scsi-SATA_Hitachi_HDS7220_JK1171YAH3M4HN
3,5   
4,5   



bexamous@nine:~/bin$ : drive pulled out
bexamous@nine:~/bin$ sudo ./storage.sh
+++++++++++++++++++++++++++++++++++++++++++
+++   Norco 4220                        +++
+++++++++++++++++++++++++++++++++++++++++++
[  /dev/sdc   ] [  /dev/sdd   ] [  /dev/sde   ] [  /dev/sdf   ] 
[  /dev/sdg   ] [  /dev/sdh   ] [  /dev/sdi   ] [  /dev/sdj   ] 
[             ] [             ] [             ] [             ] 
[  /dev/sdk   ] [  /dev/sdl   ] [  /dev/sdm   ] [  /dev/sdn   ] 
[             ] [             ] [             ] [             ] 


1,1  /dev/sdc scsi-SATA_WDC_WD10EADS-00_WD-WCAU46815978
2,1  /dev/sdd scsi-SATA_WDC_WD10EADS-00_WD-WCAU46783271
3,1  /dev/sde scsi-SATA_WDC_WD10EADS-00_WD-WCAU46803203
4,1  /dev/sdf scsi-SATA_WDC_WD1000FYPS-WD-WCASJ0318455
1,2  /dev/sdg scsi-SATA_WDC_WD10EACS-00_WD-WCAU42580399
2,2  /dev/sdh scsi-SATA_WDC_WD10EACS-00_WD-WCAU42557087
3,2  /dev/sdi scsi-SATA_WDC_WD10EADS-00_WD-WCAU46812587
4,2  /dev/sdj scsi-SATA_WDC_WD15EADS-00_WD-WCAUP0019266
1,3   
2,3   
3,3   
4,3   
1,4  /dev/sdk scsi-SATA_Hitachi_HDS7220_JK1130YAGVZSRT
2,4  /dev/sdl scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1361632
3,4  /dev/sdm scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1338263
4,4  /dev/sdn scsi-SATA_WDC_WD20EADS-00_WD-WCAVY1279474
1,5   
2,5   
3,5   
4,5   


Missing SAS device!  It had SAS Address 5001c4500009af15.
Missing disk!  GUID was: scsi-SATA_Hitachi_HDS7220_JK1171YAH3M4HN.
Disk missing from Chassis bay 2,5; disk was /dev/sdo, GUID was scsi-SATA_Hitachi_HDS7220_JK1171YAH3M4HN.

bexamous@nine:~/bin$
 
Nice script!

Would you list your hardware (controller and SAS expander make and model) in case it is relevant to someone? Also, the driver version you are using for your 1068E based controller.
 
Nice script. I am unable to use it though on my AOC-SASLP-MV8 (mvsas) controller. Does it work only with LSI controllers?
 
Yeah, it only works on LSI controllers, either the mptsas or mpt2sas driver. Works with both HP & Chenbro SAS expanders, thats all I've tried.
 
You must log in or register to reply here.
Back
Top