Tories were more supportive of staying than expected, but the Labour vote was far weaker for Remain than they had hoped.