Yes, generally, except after you delete the array you should replace the drives one at a time and format each new drive after installing it. The OS is installed on the drives, so if you remove them all the unit won't boot. Formatting the drive puts the OS on it.
Once all 4 new drives are in and formatted you should be able to create a new RAID 5.