Small Tobacco Farmer Tax Relief Act of 2005 - Amends the Internal Revenue Code to exclude from gross income up to $5,000 annually of contract payments to tobacco quota holders and producers of quota tobacco provided by the Fair and Equitable Tobacco Reform Act of 2004. Terminates such tax exclusion for taxable years beginning after 2014.