I switched the orientation of the power supply so the fan is facing up toward the sky pulling air in when its under load, and the noise is gone. running intel burn test for 30+mins and fan is spinning with no horrible sounds!
If im in your shoes, i would still try to get a replacement. A proper working one woudn't have noise issue no matter what orientation it sits.That's just me.