Women's Health Office Act of 2004 - Amends the Public Health Service Act, the Social Security Act, and the Federal Food, Drug, and Cosmetic Act to require the establishment of separate Offices on Women's Health within the Office of the Secretary of Health and Human Services, the Office of the Director of the Centers for Disease Control and Prevention, the Office of the Administrator of the Health Resources and Services Administration, and the Office of the Commissioner of the Food and Drug Administration to carry out specified activities relating to the health of women. Directs the lead officers of each Office of Women's Health to establish goals, provide information, serve as a consultant, and establish a Coordinating Committee on Women's Health within their respective agencies.
Requires the Director of the Agency of Healthcare Research and Quality to designate an official of the Office of Priority Populations to carry out similar responsibilities relating to women's health.
Requires the Secretary, acting through the Office of Women's Health, to establish a National Women's Health Information Center to facilitate the exchange of information, access to such information, and the analysis of issues and problems relating to women's health.
Transfers the functions of the Office on Women's Health of the Public Health Service to the Office of Women's Health within the Department of Health and Human Services.