As long as you don't tell them you plan to drop when they tell you they're thinking about dropping, then it's no big deal. Just do it. They shouldn't have any more say in what you do than you have in what they do.