Community Disaster Loan Act of 2005 - Authorizes the transfer of up to $750 million, of the "Disaster Relief" amounts provided in Public Law 109-62, to the Disaster Assistance Direct Loan Program (including up to $1 million for related administrative expenses) for the cost of direct loans as authorized under the Robert T. Stafford Disaster Relief and Emergency Assistance Act. Requires such funds to be used to assist local governments in providing essential services. Allows such transfer to subsidize gross obligations for the principal amount of direct loans not to exceed $1 billion under the Stafford Act. Permits the amount of any such loan to exceed $5 million.