Agriculture Fire Assistance Act of 2006 - Directs the Secretary of Agriculture to provide assistance: (1) to agricultural producers who incurred fire-caused losses in 2006 for livestock indemnity payments and feed assistance; (2) for the emergency conservation and watershed protection programs, with priority given to producers who incurred fire-caused losses in 2006; and (3) for environmental quality incentive payments to producers who incurred fire-caused losses in 2006.