본문 바로가기

Work/Solaris

Oracle T 장비 H/W 레이드카드로 인한 볼륨 인식 (Solaris10)

대상장비 : T5220 

작업내용 : 디스크 2개 추가 후 미러 구성 



< 현재상태 >


flyyunha[/]echo | format

Searching for disks...done

AVAILABLE DISK SELECTIONS:

       0. c1t0d0 <LSILOGIC-LogicalVolume-3000 cyl 65533 alt 2 hd 16 sec 273>

          /pci@0/pci@0/pci@2/scsi@0/sd@0,0

       1. c2t0d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@0,1f

       2. c2t1d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@1,1f

       3. c3t600A0B80005B0B36000001B44A179D97d0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 128 sec 139>

          /scsi_vhci/disk@g600a0b80005b0b36000001b44a179d97

       4. c3t600A0B80005B0B36000001B74A179DFAd0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 64 sec 278>

          /scsi_vhci/disk@g600a0b80005b0b36000001b74a179dfa


< 디스크 추가 후 >

flyyunha[/]devfsadm -Cc disk

flyyunha[/]format

Searching for disks...done



AVAILABLE DISK SELECTIONS:

       0. c1t0d0 <LSILOGIC-LogicalVolume-3000 cyl 65533 alt 2 hd 16 sec 273>

          /pci@0/pci@0/pci@2/scsi@0/sd@0,0

       1. c2t0d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@0,1f

       2. c2t1d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@1,1f

       3. c3t600A0B80005B0B36000001B44A179D97d0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 128 sec 139>

          /scsi_vhci/disk@g600a0b80005b0b36000001b44a179d97

       4. c3t600A0B80005B0B36000001B74A179DFAd0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 64 sec 278>

          /scsi_vhci/disk@g600a0b80005b0b36000001b74a179dfa


==> 디스크 인식이 되지 않음


flyyunha[/]cfgadm -al

Ap_Id                          Type         Receptacle   Occupant     Condition

c1                             scsi-bus     connected    configured   unknown

c1::dsk/c1t0d0                 disk         connected    configured   unknown

c2                             scsi-bus     connected    configured   unknown

c2::dsk/c2t0d31                disk         connected    configured   unknown

c2::dsk/c2t1d31                disk         connected    configured   unknown

usb0/1                         unknown      empty        unconfigured ok

usb0/2                         unknown      empty        unconfigured ok

usb0/3                         unknown      empty        unconfigured ok

usb1/1                         unknown      empty        unconfigured ok

usb1/2                         unknown      empty        unconfigured ok

usb2/1                         unknown      empty        unconfigured ok

usb2/2                         usb-storage  connected    configured   ok

usb2/3                         unknown      empty        unconfigured ok

usb2/4                         usb-hub      connected    configured   ok

usb2/4.1                       unknown      empty        unconfigured ok

usb2/4.2                       unknown      empty        unconfigured ok

usb2/4.3                       unknown      empty        unconfigured ok

usb2/4.4                       unknown      empty        unconfigured ok

usb2/5                         unknown      empty        unconfigured ok


==> 여기서도 보이지가 않음, 디스크에서는 불이 들어옴


flyyunha[/]ls -lR /devices > /dev/null

flyyunha[/]devfsadm


==> 드라이브 초기화 해도 마찬가지

       재부팅을 해야 하나? 하는 도중에 레이드 카드로 인해서 그렇지 않나 싶어서 찾아보니


flyyunha[/]raidctl

Controller: 1

        Volume:c1t0d0

        Volume:c1t132d0

        Disk: 0.1.0

        Disk: 0.2.0

        Disk: 0.3.0

        Disk: 0.4.0

Controller: 2

        Disk: 0.0.0

        Disk: 0.1.0


==> raidctl 이런 명령어가 있음  


flyyunha[/]raidctl -l c1t132d0

Volume                  Size    Stripe  Status   Cache  RAID

        Sub                     Size                    Level

                Disk                                    

----------------------------------------------------------------

c1t132d0                

                0.3.0   

                0.6.0   

flyyunha[/]raidctl -l c1t0d0

Volume                  Size    Stripe  Status   Cache  RAID

        Sub                     Size                    Level

                Disk                                    

----------------------------------------------------------------

c1t0d0                  136.6G  N/A     OPTIMAL  ON     RAID1

                0.1.0   136.6G          GOOD    

                0.2.0   136.6G          GOOD  



==> c1t0d0 은 디스크 0.1.0 과 0.2.0 으로 h/w 레이드 구성이 미러로 되어 있다는 소리

       c1t132d0 은 디스크 0.3.0 과 0.6.0 으로 묶어져 있다고는 되어 있지만 있지도 않은 디스크        0.6.0 이 들어가있고 디스크에 대한 정보도 없음


flyyunha[/]raidctl -C "0.3.0 0.4.0" -r 1 1

Creating RAID volume will destroy all data on spare space of member disks, proceed (yes/no)? yes

Disk has occupied space.


==> 미러구성을 다시 시도하니 Disk has occupied space 라면서 다른대서 먼저 사용하고 

       있어서 불가능 하다고 함 


※ https://docs.oracle.com/cd/E19839-01/E21875-01/z40001e11389338.html

The Sun SPARC Enterprise T5120 or T5220 server’s on-board SAS controller can configure as many as two RAID volumes. Prior to volume creation, ensure that the member disks are available and that there are not two volumes already created.

추가로 T5120 / T5220 장비의 onboard sas controller 에서는 2개의 raid volumes 만 생성 가능


flyyunha[/]raidctl

Controller: 1

        Volume:c1t0d0

        Volume:c1t132d0

        Disk: 0.1.0

        Disk: 0.2.0

        Disk: 0.3.0

        Disk: 0.4.0

Controller: 2

        Disk: 0.0.0

        Disk: 0.1.0


==> volume c1t132d0 삭제 


flyyunha[/]raidctl -d c1t132d0

Deleting RAID volume c1t132d0 will destroy all data it contains, proceed (yes/no)? yes

Volume c1t132d0 is deleted successfully!

flyyunha[/]raidctl

Controller: 1

        Volume:c1t0d0

        Volume:c1t134d0

        Disk: 0.1.0

        Disk: 0.2.0

        Disk: 0.3.0

        Disk: 0.4.0

Controller: 2

        Disk: 0.0.0

        Disk: 0.1.0


==> 삭제 했더니 c1t132d0 이란 녀석이 나옴


flyyunha[/]echo | format

Searching for disks...done


c3t5000C5000EB3D24Bd0: configured with capacity of 136.71GB



AVAILABLE DISK SELECTIONS:

       0. c1t0d0 <LSILOGIC-LogicalVolume-3000 cyl 65533 alt 2 hd 16 sec 273>

          /pci@0/pci@0/pci@2/scsi@0/sd@0,0

       1. c2t0d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@0,1f

       2. c2t1d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@1,1f

       3. c3t600A0B80005B0B36000001B44A179D97d0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 128 sec 139>

          /scsi_vhci/disk@g600a0b80005b0b36000001b44a179d97

       4. c3t600A0B80005B0B36000001B74A179DFAd0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 64 sec 278>

          /scsi_vhci/disk@g600a0b80005b0b36000001b74a179dfa

       5. c3t5000C5000EB3D24Bd0 <SUN146G cyl 14087 alt 2 hd 24 sec 848>

          /scsi_vhci/disk@g5000c5000eb3d24b

Specify disk (enter its number): Specify disk (enter its number): 

flyyunha[/]raidctl -d c1t134d0

Deleting RAID volume c1t134d0 will destroy all data it contains, proceed (yes/no)? yes

Volume c1t134d0 is deleted successfully!


==> 마찬가지로 사용하지 않는 녀석이기에 삭제


flyyunha[/]raidctl

Controller: 1

        Volume:c1t0d0

        Disk: 0.1.0

        Disk: 0.2.0

        Disk: 0.3.0

        Disk: 0.4.0

Controller: 2

        Disk: 0.0.0

        Disk: 0.1.0

flyyunha[/]echo | format

Searching for disks...done


c3t5000C5000EB2AB9Fd0: configured with capacity of 136.71GB

c3t5000C5000EB3D24Bd0: configured with capacity of 136.71GB



AVAILABLE DISK SELECTIONS:

       0. c1t0d0 <LSILOGIC-LogicalVolume-3000 cyl 65533 alt 2 hd 16 sec 273>

          /pci@0/pci@0/pci@2/scsi@0/sd@0,0

       1. c2t0d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@0,1f

       2. c2t1d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@1,1f

       3. c3t600A0B80005B0B36000001B44A179D97d0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 128 sec 139>

          /scsi_vhci/disk@g600a0b80005b0b36000001b44a179d97

       4. c3t600A0B80005B0B36000001B74A179DFAd0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 64 sec 278>

          /scsi_vhci/disk@g600a0b80005b0b36000001b74a179dfa

       5. c3t5000C5000EB2AB9Fd0 <SUN146G cyl 14087 alt 2 hd 24 sec 848>

          /scsi_vhci/disk@g5000c5000eb2ab9f

       6. c3t5000C5000EB3D24Bd0 <SUN146G cyl 14087 alt 2 hd 24 sec 848>

          /scsi_vhci/disk@g5000c5000eb3d24b


==> H/W raid 볼륨을 하나만 남겼더니 disk 를 o/s 에서 각각 인식 



 flyyunha[/]raidctl -C "0.3.0 0.4.0" -r 1 1

Creating RAID volume will destroy all data on spare space of member disks, proceed (yes/no)? yes

Volume c1t3d0 is created successfully!

Volume                  Size    Stripe  Status   Cache  RAID

        Sub                     Size                    Level

                Disk                                    

----------------------------------------------------------------

c1t3d0                  136.6G  N/A     SYNC     OFF    RAID1

                0.5.0   136.6G          GOOD    

                0.4.0   136.6G          GOOD    


==> 디스크 h/w raid 미러 구성


flyyunha[/]raidctl

Controller: 1

        Volume:c1t0d0

        Volume:c1t3d0

        Disk: 0.1.0

        Disk: 0.2.0

        Disk: 0.4.0

        Disk: 0.5.0

Controller: 2

        Disk: 0.0.0

        Disk: 0.1.0

flyyunha[/]echo | format

Searching for disks...done


c1t3d0: configured with capacity of 136.49GB



AVAILABLE DISK SELECTIONS:

       0. c1t0d0 <LSILOGIC-LogicalVolume-3000 cyl 65533 alt 2 hd 16 sec 273>

          /pci@0/pci@0/pci@2/scsi@0/sd@0,0

       1. c1t3d0 <LSILOGIC-LogicalVolume-3000 cyl 65533 alt 2 hd 16 sec 273>

          /pci@0/pci@0/pci@2/scsi@0/sd@3,0

       2. c2t0d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@0,1f

       3. c2t1d31 <SUN-UniversalXport-0735 cyl 8 alt 2 hd 64 sec 64>

          /pci@0/pci@0/pci@8/pci@0/pci@a/LSILogic,sas@0/sd@1,1f

       4. c3t600A0B80005B0B36000001B44A179D97d0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 128 sec 139>

          /scsi_vhci/disk@g600a0b80005b0b36000001b44a179d97

       5. c3t600A0B80005B0B36000001B74A179DFAd0 <SUN-LCSM100_S-0735 cyl 65533 alt 2 hd 64 sec 278>

          /scsi_vhci/disk@g600a0b80005b0b36000001b74a179dfa

Specify disk (enter its number): Specify disk (enter its number): 

flyyunha[/]raidctl -l c1t3d0

Volume                  Size    Stripe  Status   Cache  RAID

        Sub                     Size                    Level

                Disk                                    

----------------------------------------------------------------

c1t3d0                  136.6G  N/A     SYNC     OFF    RAID1

                0.5.0   136.6G          GOOD    

                0.4.0   136.6G          GOOD    


==> 미러구성하니 서버에서 인식 완료


flyyunha[/]cfgadm -al

Ap_Id                          Type         Receptacle   Occupant     Condition

c1                             scsi-bus     connected    configured   unknown

c1::dsk/c1t0d0                 disk         connected    configured   unknown

c1::dsk/c1t3d0                 disk         connected    configured   unknown

c2                             scsi-bus     connected    configured   unknown

c2::dsk/c2t0d31                disk         connected    configured   unknown

c2::dsk/c2t1d31                disk         connected    configured   unknown

usb0/1                         unknown      empty        unconfigured ok

usb0/2                         unknown      empty        unconfigured ok

usb0/3                         unknown      empty        unconfigured ok

usb1/1                         unknown      empty        unconfigured ok

usb1/2                         unknown      empty        unconfigured ok

usb2/1                         unknown      empty        unconfigured ok

usb2/2                         usb-storage  connected    configured   ok

usb2/3                         unknown      empty        unconfigured ok

usb2/4                         usb-hub      connected    configured   ok

usb2/4.1                       unknown      empty        unconfigured ok

usb2/4.2                       unknown      empty        unconfigured ok

usb2/4.3                       unknown      empty        unconfigured ok

usb2/4.4                       unknown      empty        unconfigured ok

usb2/5                         unknown      empty        unconfigured ok


※ 여기서 드는 생각

1. h/w raid volume 으로 인해 디스크를 추가 했을시 바로 인식이 안됨

   인식이라기 보다는 o/s 에서 사용할 수가 없음 

    raid volume 을 삭제 하니 디스크가 인식 

   앞으로 이 서버에서 disk 추가시 volume 구성을 추가 할 수 없으니

   ( Default 2개 까지니깐 ) disk 추가해도 사용 불가?

   아니면 h/w raid volume 에 추가? 할 수도 없고 어떻게 사용해야 하는거지 ?



** 요약 **

1. T5120/T5220 장비에서 디스크 추가 하려고 함

2. 기존의 H/W raid volume 이 2개 있었음 

   # raidctl

3. 디스크가 인식 불가 ( o/s 에서 사용 불가 )

4. 기존의 volume 2개 중 한개가 이상한 녀석이라 삭제 후 인식

   # raidctl -d c1t132d0

5. 추가한 디스크 h/w raid volume 구성 & 사용

   # raidctl -C "0.3.0 0.4.0" -r 1 1 

   # raidctl - c1t3d0 

   # newfs /dev/rdsk/c1t3d0