Prescription Drug Safety and Affordability Act of 2006 - Amends the Internal Revenue Code to deny prescription drug manufacturers a tax deduction for gifts to physicians, including gifts of meals, sponsored teachings, symposia, and travel (but not including product samples).