Jackson the democrat feared that annexing Texas would lead to a war with Mexico which he was not ready for. However,another problem was caused by the issue of balancing slave states with free states. Texas was a free state and therefore would cause an imbalance to the union.
