Family Building Act of 2005 - Amends the Public Health Service Act, the Employee Retirement Income Security Act of 1974 (ERISA), the Federal Employees Health Benefits Plan, and defense health care plan law to require health plans to provide benefits for treatment of infertility in accord with specified standards.