Working Families Access to Justice Act of 2004 - Amends the National Labor Relations Act to require attorneys' fees to be awarded to the prevailing party in an administrative or court proceeding involving the National Labor Relations Board if such party is an employer or labor organization that, at the time of such adversary adjudication or civil action, had not more than 100 employees and not more than $7 million of net worth.