I have a small file server at home running OpenIndian to store various media libraries and local backups. This machine is a SuperMicro X7SPA-H with a dual core Intel Atom D525 and 2GB of laptop memory from an old MacBook Pro. The 5 disk JBOD is made up of 4 Seagate 1.5TB Barracuda 7200RPM SATA2 drives, and 1 Western Digital 2.5TB Caviar Green SATA3 drive. In hind site, the Seagate disks were not the greatest choice as they are prone to failure. Seagate does have a great warranty and RMA process. Advance replacement is only $10 with with an included return label. that is $2 less than what I paid for the first drive to be sent via UPS.
Recently one of the raidz disks started clicking and producing read/write/checksum errors. I yanked it out and the spare took over as expected. I shipped off that bad disk to Seagate's Texas RMA facility for a replacement.
Before the replacement disk arrived the SPARE disk started the same behavior! Clicking and lots of errors. Yanked the drive and RMAd the disk.
I had waited far longer than I should have to get the new disk in and re-silver the pool. A couple hundred GBs of data had been written since both disks failed, and so there was a lot of data to re-distribute. The entire process of scanning the entire 2 SATA disks, checksumming, and re-distributing of 613GB of data was completed in less than 5 HOURS! I am really quite impressed by this little Atom box.
root@openindiana:~# zpool list NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT rpool 1.98T 1.87T 114G 94% 1.00x ONLINE - tank 4.06T 1.81T 2.25T 44% 1.00x ONLINE - root@openindiana:~# zpool status pool: rpool state: ONLINE scan: scrub repaired 0 in 4h36m with 0 errors on Mon May 21 06:21:46 2012 config: NAME STATE READ WRITE CKSUM rpool ONLINE 0 0 0 c3t2d0s0 ONLINE 0 0 0 errors: No known data errors pool: tank state: ONLINE scan: resilvered 613G in 4h6m with 0 errors on Mon Jul 23 13:48:48 2012 config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 c3t1d0p0 ONLINE 0 0 0 c3t0d0p0 ONLINE 0 0 0 c3t3d0p0 ONLINE 0 0 0 spares /dev/ad12 UNAVAIL cannot open errors: No known data errors root@openindiana:~#
Now I just need to get the spare back in the pool to clear up the remnants of FreeBSD(FreeNAS really).