Why impose a tax when you can remove a subsidy?

Would it not make more sense to remove the subsidy, and save the taxpayer money, rather than impose yet another tax?

Several previous governments have tried to remove the subsidy but have backed down in the face of widespread public protests and reduced it instead.