Taxpayer Campaign Fund Elimination Act of 2005 - Amends the Internal Revenue Code to terminate, after 2005: (1) taxpayer checkoffs to finance presidential election campaigns; (2) the Presidential Election Campaign Fund (Fund) and related provisions; and (3) presidential primary matching payment accounts. Directs the Secretary of the Treasury to transfer any amounts remaining in the Fund after 2005 to the general fund of the Treasury.