Employee Stock Ownership Plan Promotion and Improvement Act of 2004 - Amends the Internal Revenue Code to: (1) treat certain distributions by S corporations to an employee stock ownership plan (ESOP) as deductible dividends; (2) exempt deductions for ESOP dividends from corporate alternative minimum tax adjustments based on adjusted earnings and profits; (3) allow deferral of the recognition of gain for certain sales to ESOP's sponsored by any domestic corporation, including S corporations; (4) allow reinvestment of ESOP stock proceeds eligible for nonrecognition of gain in certain mutual funds; (5) modify certain ESOP stock ownership rules; and (6) allow early distributions from an ESOP for higher education expenses and first-time homebuyer purchases without penalty.