One of the most frequently heard assertions by Brexiteers keen to be seen as open-minded and liberal is that the UK is leaving the EU, not Europe.