It's not really a bind. They could just as easily say "Sorry, Sweden, he made it to neutral ground" as "we're going to violate the Vienna Convention". At this stage it's all politics; if the UK is threatening to do this, then it's getting something out of the deal.