Documentation/blockdev/README.DAC960

14 	 Copyright 1998-2001 by Leonard N. Zubkoff <lnz@dandelion.com>
33 and DAC960PJ/PG/PU/PD/PL.  See below for a complete controller list as well as
41 the controller's operation, and a detailed description of your system's
47 Please consult the RAID controller documentation for detailed information
64 of the controller and adding new disk drives, most everything can be handled
68 Each DAC960 parallel SCSI controller can support up to 15 disk drives per
69 channel, for a maximum of 60 drives on a four channel controller; the fibre
70 channel eXtremeRAID 3000 controller supports up to 125 disk drives per loop for
71 a total of 250 drives.  The drives installed on a controller are divided into
82 System (DEVFS).  The device corresponding to Logical Drive D on Controller C
85 Controller 2 is referred to as /dev/rd/c2d5p3.  Note that unlike with SCSI
87 The DAC960 driver is assigned major numbers 48 - 55 with one major number per
88 controller.  The 8 bits of minor number are divided into 5 bits for the Logical
96 anyone purchasing a Mylex PCI RAID Controller not in the following table
100 	    1 Wide Ultra-2/LVD SCSI channel
101 	    2 External Fibre FC-AL channels
104 	    32MB/64MB ECC SDRAM Memory
107 	    4 Wide Ultra-160 LVD SCSI channels
110 	    32MB/64MB ECC SDRAM Memory
113 	    2 Wide Ultra-160 LVD SCSI channels
116 	    32MB/64MB ECC SDRAM Memory
119 	    1 Wide Ultra-160 LVD SCSI channel
121 	    16MB/32MB/64MB ECC SDRAM Memory
124 	    1 Wide Ultra-160 LVD SCSI channel
126 	    Built in 16M ECC SDRAM Memory
127 	    PCI Low Profile Form Factor - fit for 2U height
130 	    3 Wide Ultra-2/LVD SCSI channels
133 	    16MB/32MB/64MB Parity SDRAM Memory with Battery Backup
137 	    Also includes one onboard Wide Ultra-2/LVD SCSI Channel
139 	    4MB/8MB/16MB/32MB/64MB/128MB ECC EDO Memory
145 	    4MB/8MB/16MB/32MB/64MB/128MB ECC EDO Memory
149 	    Also includes one onboard Wide Ultra-2/LVD SCSI Channel
151 	    4MB Parity EDO Memory
153 DAC960PJ    1/2/3 Wide Ultra SCSI-3 Channels
155 	    4MB/8MB/16MB/32MB/64MB/128MB ECC EDO Memory
157 DAC960PG    1/2/3 Wide Ultra SCSI-3 Channels
159 	    4MB/8MB ECC EDO Memory
161 DAC960PU    1/2/3 Wide Ultra SCSI-3 Channels
163 	    4MB/8MB EDRAM or 2MB/4MB/8MB/16MB/32MB DRAM Memory
165 DAC960PD    1/2/3 Wide Fast SCSI-2 Channels
167 	    4MB/8MB EDRAM or 2MB/4MB/8MB/16MB/32MB DRAM Memory
169 DAC960PL    1/2/3 Wide Fast SCSI-2 Channels
171 	    2MB/4MB/8MB/16MB/32MB DRAM Memory
173 DAC960P	    1/2/3 Wide Fast SCSI-2 Channels
175 	    2MB/4MB/8MB/16MB/32MB DRAM Memory
178 6.00-01 or above is required.
180 For the eXtremeRAID 1100, firmware version 5.06-0-52 or above is required.
182 For the AcceleRAID 250, 200, and 150, firmware version 4.06-0-57 or above is
185 For the DAC960PJ and DAC960PG, firmware version 4.06-0-00 or above is required.
188 3.51-0-04 or above is required (for dual Flash ROM controllers), or firmware
189 version 2.73-0-00 or above is required (for single Flash ROM controllers)
195 DAC960PJ, and DAC960PG because the Intel i960RD/RP is a multi-function device.
198 http://www.mylex.com/support/hdcomp/hd-lists.html.
209   tar -xvzf DAC960-2.2.11.tar.gz (or DAC960-2.4.11.tar.gz)
212   patch -p0 < DAC960.patch (if DAC960.patch is included)
221 "DAC960-Utilities.tar.gz" from http://www.dandelion.com/Linux/ may be used.
225 will allow booting from a DAC960 controller and/or mounting the root file
236 system, the controller must first be configured to provide one or more logical
245 can be enabled by configuring the DAC960 BIOS, which is accessible via Alt-M
250 stride to match the DAC960 controller's 64KB default stripe size.  The command
251 "mke2fs -b 4096 -R stride=16 <device>" is appropriate.  Unless there will be a
253 the "-i 16384" option to increase the bytes per inode parameter thereby
256 with the "-s 1" option.
264 "dac960-announce-request@dandelion.com" with the line "subscribe" in the
268 		CONTROLLER CONFIGURATION AND STATUS MONITORING
273 Configuration Utility (accessible via Alt-R during the BIOS initialization
274 sequence) is used to quickly configure the controller, and then the logical
276 are still being initialized by the controller.  The primary need for online
280 the future.  Note that with a SAF-TE (SCSI Accessed Fault-Tolerant Enclosure)
281 enclosure, the controller is able to rebuild failed drives automatically as
284 The primary interfaces for controller configuration and status monitoring are
287 driver queries each controller for status information every 10 seconds, and
289 controller is always available for controller N in /proc/rd/cN/initial_status,
300 available) for each physical device found connected to the controller:
303 Copyright 1998-1999 by Leonard N. Zubkoff <lnz@dandelion.com>
304 Configuring Mylex DAC960PRL PCI RAID Controller
305   Firmware Version: 4.07-0-07, Channels: 1, Memory Size: 16MB
308   Controller Queue Depth: 128, Maximum Blocks per Command: 128
311   SAF-TE Enclosure Management Enabled
331     0:6  Vendor: ESG-SHV   Model: SCA HSBP M6       Revision: 0.61
333     /dev/rd/c0d0: RAID-5, Online, 89640960 blocks, Write Thru
339 drives are offline or critical or any non-standby physical drives are dead.
341 Configuration commands for controller N are available via the special file
347   echo "<configuration-command>" > /proc/rd/c0/user_command
353   flush-cache
355     The "flush-cache" command flushes the controller's cache.  The system
359     Note that the flush-cache command also stops an asynchronous rebuild or
363   kill <channel>:<target-id>
365     The "kill" command marks the physical drive <channel>:<target-id> as DEAD.
369   make-online <channel>:<target-id>
371     The "make-online" command changes the physical drive <channel>:<target-id>
377     Warning: make-online should only be used on a dead physical drive that is
382   make-standby <channel>:<target-id>
384     The "make-standby" command changes physical drive <channel>:<target-id>
387     standby drive.  It cannot be used to add a standby drive to the controller
391   rebuild <channel>:<target-id>
394     <channel>:<target-id>.  It should only be used when a dead drive has been
397   check-consistency <logical-drive-number>
399     The "check-consistency" command initiates an asynchronous consistency check
400     of <logical-drive-number> with automatic restoration.  It can be used
404   cancel-rebuild
405   cancel-consistency-check
407     The "cancel-rebuild" and "cancel-consistency-check" commands cancel any
411 	       EXAMPLE I - DRIVE FAILURE WITHOUT A STANDBY DRIVE
413 The following annotated logs demonstrate the controller configuration and and
416 DAC960PJ controller.  The physical drives are configured into a single drive
418 logical drives, one RAID-5 and one RAID-6.  Note that these logs are from an
425 Copyright 1998-1999 by Leonard N. Zubkoff <lnz@dandelion.com>
426 Configuring Mylex DAC960PJ PCI RAID Controller
427   Firmware Version: 4.06-0-08, Channels: 3, Memory Size: 8MB
430   Controller Queue Depth: 128, Maximum Blocks per Command: 128
434     0:1 - Disk: Online, 2201600 blocks
435     0:2 - Disk: Online, 2201600 blocks
436     0:3 - Disk: Online, 2201600 blocks
437     1:1 - Disk: Online, 2201600 blocks
438     1:2 - Disk: Online, 2201600 blocks
439     1:3 - Disk: Online, 2201600 blocks
441     /dev/rd/c0d0: RAID-5, Online, 5498880 blocks, Write Thru
442     /dev/rd/c0d1: RAID-6, Online, 3305472 blocks, Write Thru
449 returns "OK" indicating that there are no problems with any DAC960 controller
452 the driver within 10 seconds of the controller's having detected it, and the
464 arising from a SCSI bus reset that is forced by the controller during its error
477     0:1 - Disk: Online, 2201600 blocks
478     0:2 - Disk: Online, 2201600 blocks
479     0:3 - Disk: Online, 2201600 blocks
480     1:1 - Disk: Dead, 2201600 blocks
481     1:2 - Disk: Online, 2201600 blocks
482     1:3 - Disk: Online, 2201600 blocks
484     /dev/rd/c0d0: RAID-5, Critical, 5498880 blocks, Write Thru
485     /dev/rd/c0d1: RAID-6, Critical, 3305472 blocks, Write Thru
494 controller to initiate a rebuild operation onto the newly replaced drive:
500 The echo command instructs the controller to initiate an asynchronous rebuild
510 DAC960#0: Physical Drive 1:1 is now WRITE-ONLY
518     0:1 - Disk: Online, 2201600 blocks
519     0:2 - Disk: Online, 2201600 blocks
520     0:3 - Disk: Online, 2201600 blocks
521     1:1 - Disk: Write-Only, 2201600 blocks
522     1:2 - Disk: Online, 2201600 blocks
523     1:3 - Disk: Online, 2201600 blocks
525     /dev/rd/c0d0: RAID-5, Critical, 5498880 blocks, Write Thru
526     /dev/rd/c0d1: RAID-6, Critical, 3305472 blocks, Write Thru
535     0:1 - Disk: Online, 2201600 blocks
536     0:2 - Disk: Online, 2201600 blocks
537     0:3 - Disk: Online, 2201600 blocks
538     1:1 - Disk: Write-Only, 2201600 blocks
539     1:2 - Disk: Online, 2201600 blocks
540     1:3 - Disk: Online, 2201600 blocks
542     /dev/rd/c0d0: RAID-5, Critical, 5498880 blocks, Write Thru
543     /dev/rd/c0d1: RAID-6, Critical, 3305472 blocks, Write Thru
566     0:1 - Disk: Online, 2201600 blocks
567     0:2 - Disk: Online, 2201600 blocks
568     0:3 - Disk: Online, 2201600 blocks
569     1:1 - Disk: Online, 2201600 blocks
570     1:2 - Disk: Online, 2201600 blocks
571     1:3 - Disk: Online, 2201600 blocks
573     /dev/rd/c0d0: RAID-5, Online, 5498880 blocks, Write Thru
574     /dev/rd/c0d1: RAID-6, Online, 3305472 blocks, Write Thru
583 		EXAMPLE II - DRIVE FAILURE WITH A STANDBY DRIVE
585 The following annotated logs demonstrate the controller configuration and and
588 DAC960PJ controller.  The physical drives are configured into a single drive
590 logical drives, one RAID-5 and one RAID-6.  Note that these logs are from an
597 Copyright 1998-1999 by Leonard N. Zubkoff <lnz@dandelion.com>
598 Configuring Mylex DAC960PJ PCI RAID Controller
599   Firmware Version: 4.06-0-08, Channels: 3, Memory Size: 8MB
602   Controller Queue Depth: 128, Maximum Blocks per Command: 128
606     0:1 - Disk: Online, 2201600 blocks
607     0:2 - Disk: Online, 2201600 blocks
608     0:3 - Disk: Online, 2201600 blocks
609     1:1 - Disk: Online, 2201600 blocks
610     1:2 - Disk: Online, 2201600 blocks
611     1:3 - Disk: Standby, 2201600 blocks
613     /dev/rd/c0d0: RAID-5, Online, 4399104 blocks, Write Thru
614     /dev/rd/c0d1: RAID-6, Online, 2754560 blocks, Write Thru
621 returns "OK" indicating that there are no problems with any DAC960 controller
624 the driver within 10 seconds of the controller's having detected it, and the
635 Since a standby drive is configured, the controller automatically begins
638 DAC960#0: Physical Drive 1:3 is now WRITE-ONLY
653     0:1 - Disk: Online, 2201600 blocks
654     0:2 - Disk: Online, 2201600 blocks
655     0:3 - Disk: Online, 2201600 blocks
656     1:1 - Disk: Online, 2201600 blocks
657     1:2 - Disk: Dead, 2201600 blocks
658     1:3 - Disk: Write-Only, 2201600 blocks
660     /dev/rd/c0d0: RAID-5, Critical, 4399104 blocks, Write Thru
661     /dev/rd/c0d1: RAID-6, Critical, 2754560 blocks, Write Thru
670     0:1 - Disk: Online, 2201600 blocks
671     0:2 - Disk: Online, 2201600 blocks
672     0:3 - Disk: Online, 2201600 blocks
673     1:1 - Disk: Online, 2201600 blocks
674     1:2 - Disk: Dead, 2201600 blocks
675     1:3 - Disk: Write-Only, 2201600 blocks
677     /dev/rd/c0d0: RAID-5, Critical, 4399104 blocks, Write Thru
678     /dev/rd/c0d1: RAID-6, Critical, 2754560 blocks, Write Thru
699 Copyright 1998-1999 by Leonard N. Zubkoff <lnz@dandelion.com>
700 Configuring Mylex DAC960PJ PCI RAID Controller
701   Firmware Version: 4.06-0-08, Channels: 3, Memory Size: 8MB
704   Controller Queue Depth: 128, Maximum Blocks per Command: 128
708     0:1 - Disk: Online, 2201600 blocks
709     0:2 - Disk: Online, 2201600 blocks
710     0:3 - Disk: Online, 2201600 blocks
711     1:1 - Disk: Online, 2201600 blocks
712     1:2 - Disk: Dead, 2201600 blocks
713     1:3 - Disk: Online, 2201600 blocks
715     /dev/rd/c0d0: RAID-5, Online, 4399104 blocks, Write Thru
716     /dev/rd/c0d1: RAID-6, Online, 2754560 blocks, Write Thru
725 status.  Once dead Physical Drive 1:2 has been replaced, the controller must be
729 gwynedd:/u/lnz# echo "make-standby 1:2" > /proc/rd/c0/user_command
733 The echo command instructs the controller to make Physical Drive 1:2 into a
747     0:1 - Disk: Online, 2201600 blocks
748     0:2 - Disk: Online, 2201600 blocks
749     0:3 - Disk: Online, 2201600 blocks
750     1:1 - Disk: Online, 2201600 blocks
751     1:2 - Disk: Standby, 2201600 blocks
752     1:3 - Disk: Online, 2201600 blocks
754     /dev/rd/c0d0: RAID-5, Online, 4399104 blocks, Write Thru
755     /dev/rd/c0d1: RAID-6, Online, 2754560 blocks, Write Thru