If you are making a general statement and you say that something is the exception that proves the rule, you mean that although it seems to contradict your statement, in most other cases your statement will be true.
Dury was the exception that proves the rule that you can't make serious points withfunny lyrics.