I have a T310 with a PERC S300 and 4 drives configured in a RAID 5 array. I noticed in the logs that drive 1 had failed and the Virtual disk was now degraded. So I obtained a replacement disk put it in, set it as hot spare and began the rebuilding process. About 10 minutes into the rebuild a log entry was made stating that drive 0 now a had a medium error and had failed.
2416 Thu Oct 02 17:10:22 2014 Storage Service Disk medium error detected: Physical Disk 0:0:0 Controller 0, Connector 0
2048 Thu Oct 02 17:10:22 2014 Storage Service Device failed: Physical Disk 0:0:0 Controller 0, Connector 0
2416 Thu Oct 02 17:10:22 2014 Storage Service Disk medium error detected: Physical Disk 0:0:0 Controller 0, Connector 0
2098 Thu Oct 02 16:59:46 2014 Storage Service Global hot spare assigned: Physical Disk 0:0:1 Controller 0, Connector 0
2064 Thu Oct 02 16:59:46 2014 Storage Service Virtual disk Rebuild started: Virtual Disk 1 (MAIN) Controller 0 (PERC S300)
The rebuild continued and after a few hours showed that it was successful:
2091 Thu Oct 02 20:41:56 2014 Storage Service Virtual disk Rebuild completed: Virtual Disk 1 (MAIN) Controller 0 (PERC S300)
2124 Thu Oct 02 20:41:56 2014 Storage Service Redundancy normal: Virtual Disk 1 (MAIN) Controller 0 (PERC S300)
The virtual disk still shows degraded as you would expect with a drive failure but the last entries in the log are the two above about success.
I'm not onsite any longer so I don't know what the drive lights are doing.
This seems like an amazing coincidence that as soon the new drive starts building another failed. And if it failed during the build would the build really have been successful?
Should I get another drive and start the process again? I can't help but feel like this behavior will continue like whack-a-mole. Or do you think something else is going on here?
Additional info: I updated the firmware and driver just before I added the new drive. Thanks!