Personal Holding Company Tax Repeal Act of 2004 - Amends the Internal Revenue Code to repeal the tax on personal holding companies.