Women's Sustainability Recovery Act of 2004 - Amends the Small Business Act with respect to the women's business centers program to provide Small Business Administration funding priorities for FY 2004 for nonprofit organizations conducting projects for the benefit of small businesses owned and controlled by women. Increases from 30 to 48 the percentage of appropriated women's business center funds to be used during FY 2004 for pilot project sustainability grants. Terminates the provisions of this Act on October 1, 2004.