Rural Economic Investment Act of 2004 - Amends the Internal Revenue Code to exclude from gross income interest received by a bank or savings association that is insured under the Federal Deposit Insurance Act on a loan secured by agricultural real estate or by a leasehold mortgage on agricultural real estate (real property used for agricultural production or certain single family rural residences).