Direct Loan Reward Act of 2004 - Amends title IV (Student Assistance) of the Higher Education Act of 1965 to direct the Secretary of Education to carry out a Direct Loan Reward Program to encourage institutions of higher education to participate in the student loan program under part D, Federal Perkins Loans.
Makes the amount of financial reward payment to an institution under this Act equal to 50 percent of the savings to the Federal Government generated by the institution's participation in such part D student loan program instead of its participation in the student loan program under the part B Federal Family Education Loan Program.