So it sounds like with no load the 5V is fine. You said you removed the chips one at a time and the 5V was still loaded down.
Are all of the chips inserted correctly? There is a notch at the top of each chip, and that should correspond with the notch at the top of the socket.
What happens if...