Congressional Medal of Honor Memorial Coin Act of 2004 - Directs the Secretary of the Treasury to mint and issue not more than 50,000 five dollar gold coins and 250,000 one dollar silver coins emblematic of the values and abilities necessary to earn the Congressional Medal of Honor.
Requires the Secretary to pay the proceeds from the sale of such coins to the Riverside National Cemetery Support Committee for the purposes of: (1) maintaining the National Medal of Honor Memorial at Riverside National Cemetery; and (2) constructing and maintaining such memorials as the Committee and the Secretary of Veterans Affairs may jointly designate.