Veterans Housing Fairness Act of 2005 - Authorizes the use of veterans' housing loan benefits to purchase stock or membership in a development, project, or structure (structure) of a cooperative housing corporation as long as such structure: (1) complies with criteria prescribed by the Secretary of Veterans Affairs; and (2) is a single family residential unit.