High School Athletics Accountability Act of 2004 - Amends the Elementary and Secondary Education Act of 1965 (ESEA) to direct coeducational elementary and secondary schools, if they participate in any ESEA program, to: (1) report certain information on equality in their school athletic programs to the Commissioner for Educational Statistics; and (2) make such information available to their students and potential students, upon request, and to the public.