Is Hardware RAID seeing all my drives as RAID 5 in Ubuntu 16.4 LTS

Discussion in 'General Hardware' started by scharfshutze009, Jul 11, 2018.

  1. scharfshutze009

    scharfshutze009 [H]ard|Gawd

    Messages:
    1,862
    Joined:
    May 22, 2010
    My Gigabyte 7PESH3 and now Supermicro X9DAI-O may not be seeing all the hard drive in RAID 5 on this board along with the Areca ARC 1264IL. This is what cmd is showing:
    username@domain:~$ df -h
    Filesystem Size Used Avail Use% Mounted on
    udev 16G 0 16G 0% /dev
    tmpfs 3.2G 11M 3.2G 1% /run
    /dev/sda4 647G 8.0G 606G 2% /
    tmpfs 16G 264K 16G 1% /dev/shm
    tmpfs 5.0M 4.0K 5.0M 1% /run/lock
    tmpfs 16G 0 16G 0% /sys/fs/cgroup
    /dev/sda9 454M 64M 363M 15% /boot
    /dev/sda10 185M 1.6M 170M 1% /boot/efi
    /dev/sda6 113G 15G 93G 14% /home
    /dev/sda8 19G 733M 17G 5% /var
    /dev/sda2 489G 70M 464G 1% /u02
    /dev/sda7 3.7G 7.9M 3.5G 1% /tmp
    /dev/sda1 489G 70M 464G 1% /u01
    cgmfs 100K 0 100K 0% /run/cgmanager/fs
    tmpfs 3.2G 44K 3.2G 1% /run/user/1000
    /home/d2/.Private 113G 15G 93G 14% /home/d2
    username@domain:~$ sudo blkid
    [sudo] password for username:
    /dev/sda1: UUID="c39349c6-1b28-4834-a148-ba1676ba89fd" TYPE="ext4" PARTUUID="e23c9aba-01"
    /dev/sda2: UUID="730e31be-e4bf-4515-abe2-340f1116c358" TYPE="ext4" PARTUUID="e23c9aba-02"
    /dev/sda4: UUID="3f5cfcd9-c484-4bc3-aa76-f400201c58d3" TYPE="ext4" PARTUUID="e23c9aba-04"
    /dev/sda5: UUID="8324af2b-4a30-4e2c-8ccc-3c343dd770a9" TYPE="swap" PARTUUID="e23c9aba-05"
    /dev/sda6: UUID="4b23fd0b-b574-4cfe-a18b-35f7a8e2bb22" TYPE="ext4" PARTUUID="e23c9aba-06"
    /dev/sda7: UUID="2c40b70d-cca0-4627-9f6d-e4ee6d6f212a" TYPE="ext4" PARTUUID="e23c9aba-07"
    /dev/sda8: UUID="537f8cc2-4fe7-400d-8bd4-7a5768dda4ec" TYPE="ext4" PARTUUID="e23c9aba-08"
    /dev/sda9: UUID="a067daa7-c88b-456a-a354-5d3646cfbd55" TYPE="ext4" PARTUUID="e23c9aba-09"
    /dev/sda10: UUID="2533a80d-d9cb-40a2-a6b6-b15fdb1750de" TYPE="ext4" PARTUUID="e23c9aba-0a"
    /dev/mapper/cryptswap1: UUID="2cc7b592-d77a-4cac-bbee-18fb958800b9" TYPE="swap"
    username@domain:~$ fdisk -l
    fdisk: cannot open /dev/sdc: Permission denied
    fdisk: cannot open /dev/sdd: Permission denied
    fdisk: cannot open /dev/sdb: Permission denied
    fdisk: cannot open /dev/sda: Permission denied
    fdisk: cannot open /dev/mapper/cryptswap1: Permission denied
    username@domain~$ sudo fdisk -l
    Disk /dev/sdc: 1.8 TiB, 2000398934016 bytes, 3907029168 sectors
    Units: sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 4096 bytes
    I/O size (minimum/optimal): 4096 bytes / 4096 bytes


    Disk /dev/sdd: 1.8 TiB, 2000398934016 bytes, 3907029168 sectors
    Units: sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 4096 bytes
    I/O size (minimum/optimal): 4096 bytes / 4096 bytes


    Disk /dev/sdb: 1.8 TiB, 2000398934016 bytes, 3907029168 sectors
    Units: sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 4096 bytes
    I/O size (minimum/optimal): 4096 bytes / 4096 bytes


    Disk /dev/sda: 1.8 TiB, 2000398934016 bytes, 3907029168 sectors
    Units: sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 4096 bytes
    I/O size (minimum/optimal): 4096 bytes / 4096 bytes
    Disklabel type: dos
    Disk identifier: 0xe23c9aba

    Device Boot Start End Sectors Size Id Type
    /dev/sda1 * 2048 1040001023 1039998976 495.9G 83 Linux
    /dev/sda2 1040001024 2080002047 1040001024 495.9G 83 Linux
    /dev/sda3 2080004094 2529572863 449568770 214.4G 5 Extended
    /dev/sda4 2529572864 3907028991 1377456128 656.8G 83 Linux
    /dev/sda5 2080004096 2240002047 159997952 76.3G 82 Linux swap / Solaris
    /dev/sda6 2290356224 2529572863 239216640 114.1G 83 Linux
    /dev/sda7 2242357248 2250352639 7995392 3.8G 83 Linux
    /dev/sda8 2250354688 2290354175 39999488 19.1G 83 Linux
    /dev/sda9 2241376256 2242353151 976896 477M 83 Linux
    /dev/sda10 2240004096 2240403455 399360 195M 83 Linux

    Partition 3 does not start on physical sector boundary.
    Partition table entries are not in disk order.




    Disk /dev/mapper/cryptswap1: 76.3 GiB, 81918427136 bytes, 159996928 sectors
    Units: sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 4096 bytes
    I/O size (minimum/optimal): 4096 bytes / 4096 bytes
    username@domain:~$
     
    Last edited: Jul 11, 2018
  2. scharfshutze009

    scharfshutze009 [H]ard|Gawd

    Messages:
    1,862
    Joined:
    May 22, 2010
    What can I do I'm using Hardware RAID from my Areca ARC-1264IL PCI Express RAID Card and I switched to the Supermicro X9DAi-O aka X9DAi or X9DAi family motherboard that uses an onboard LSI SATA/SAS RAID controller with one SAS connector using a SAS to SATA converter cable that converts the SAS to 4 SATA/SAS hotswap bay backplane connectors. The case has 8 SATA/SAS hotswap bays, but the SATA drives are Seagate 2 TB SSHD's each.

    Everything I found from or about Ubuntu says to use mdadm, but that's for software RAID and I would have to wipe my drives entirely to change them over to software RAID. However, the drives are working fine except df -h says I only have 96 GB available for the home partition and I keep having to boot to recovery mode because the system won't just let me log in to the GUI after entering my password and just hangs at a login screen with no box to enter the password after enter it correctly or allowing me to change the user account selected.

    I dedicated the following to these partitions because I utimately want a Database Server that does Web Server Administration, Network Administration, and System Adminstration task too:

    /: 675 GB
    /var: 20 GB
    /home: 96 GB
    /tmp: 4 GB
    /u01: 532 GB
    /u02: 532 GB
    /boot: 500 MB
    swap: 61 GB or 2.5 times the amount of system RAM, but could use up to 188.3 if not already do so. The previous board supported up to 256 GB of physical RAM, but only had 32 GB of physical RAM installed and so does the current board.

    The hardware RAID is using RAID 5, so shouldn't the space on the hard drives be three times this except that the Ubuntu Server Installer only saw one 2 Terabyte Hard Drive during installation even after installing the RAID card driver by following the manufacturer company Areca's instructions for installing the RAID card driver first. Because RAID 5 uses 1 quarter aka (also known as) 1/4 of the storage from the first two or three drives or more for parity on the last drive considering the minimum for RAID 5 is 3 hard drives and I'm using four 2 TB Solid State Hybrid Drives.

    if you notice here swap doesn't even show up in the output from the df -h command, but it exists.

    username@domain:~$ df -h
    Filesystem Size Used Avail Use% Mounted on
    udev 16G 0 16G 0% /dev
    tmpfs 3.2G 11M 3.2G 1% /run
    /dev/sda4 647G 8.0G 606G 2% /
    tmpfs 16G 264K 16G 1% /dev/shm
    tmpfs 5.0M 4.0K 5.0M 1% /run/lock
    tmpfs 16G 0 16G 0% /sys/fs/cgroup
    /dev/sda9 454M 64M 363M 15% /boot
    /dev/sda10 185M 1.6M 170M 1% /boot/efi
    /dev/sda6 113G 15G 93G 14% /home
    /dev/sda8 19G 733M 17G 5% /var
    /dev/sda2 489G 70M 464G 1% /u02
    /dev/sda7 3.7G 7.9M 3.5G 1% /tmp
    /dev/sda1 489G 70M 464G 1% /u01
    cgmfs 100K 0 100K 0% /run/cgmanager/fs
    tmpfs 3.2G 44K 3.2G 1% /run/user/1000
    /home/d2/.Private 113G 15G 93G 14% /home/d2
    username@domain:~$

    I know the swap partition exists because the output of the blkid command says it does here:

    username@domain:~$ sudo blkid
    [sudo] password for username:
    /dev/sda1: UUID="c39349c6-1b28-4834-a148-ba1676ba89fd" TYPE="ext4" PARTUUID="e23c9aba-01"
    /dev/sda2: UUID="730e31be-e4bf-4515-abe2-340f1116c358" TYPE="ext4" PARTUUID="e23c9aba-02"
    /dev/sda4: UUID="3f5cfcd9-c484-4bc3-aa76-f400201c58d3" TYPE="ext4" PARTUUID="e23c9aba-04"
    /dev/sda5: UUID="8324af2b-4a30-4e2c-8ccc-3c343dd770a9" TYPE="swap" PARTUUID="e23c9aba-05"
    /dev/sda6: UUID="4b23fd0b-b574-4cfe-a18b-35f7a8e2bb22" TYPE="ext4" PARTUUID="e23c9aba-06"
    /dev/sda7: UUID="2c40b70d-cca0-4627-9f6d-e4ee6d6f212a" TYPE="ext4" PARTUUID="e23c9aba-07"
    /dev/sda8: UUID="537f8cc2-4fe7-400d-8bd4-7a5768dda4ec" TYPE="ext4" PARTUUID="e23c9aba-08"
    /dev/sda9: UUID="a067daa7-c88b-456a-a354-5d3646cfbd55" TYPE="ext4" PARTUUID="e23c9aba-09"
    /dev/sda10: UUID="2533a80d-d9cb-40a2-a6b6-b15fdb1750de" TYPE="ext4" PARTUUID="e23c9aba-0a"
    /dev/mapper/cryptswap1: UUID="2cc7b592-d77a-4cac-bbee-18fb958800b9" TYPE="swap"
     
    Last edited: Jul 12, 2018
  3. scharfshutze009

    scharfshutze009 [H]ard|Gawd

    Messages:
    1,862
    Joined:
    May 22, 2010
    Well it turns out it wasn't seeing all of the partitions on the other disks or arrays according to the output of the sudo update-initrmfs -u while trying to fix swap that seems to be the problem not especially since /dev/mapper/cryptswap1 keeps changing UUID's even though I added it to the /etc/default/grub and /etc/initramfs-tools/conf.d/resume files. My server won't communicate with the gateway or router either and I followed the examples in the Ubuntu Documentation too. When trying to resolve my issue with swap I followed the examples in Swap Faq here on Ubuntu's website:

    https://help.ubuntu.com/community/SwapFaq
     
    Last edited: Jul 31, 2018