This is an issue with early batches of the PSP 4GB HDD, which has now been fixed. Take your unit back to the retailer from which you bought it for a replacement.