Education Tax Credit Simplification Act of 2004 - Amends the Internal Revenue Code to revise the Hope and Lifetime Learning Tax Credits. Combines both credits into an Education Credit that allows certain students a tax credit of 50 percent of their qualified higher education expenses and educational expenses to acquire or improve job skills, up to $3,000 per year. Eliminates the annual cost of living adjustments to the allowable credit amount.