His feelings and well-being matter much more than your burden of guilt.
The Sun
We invented a good many countries, several of which are grateful to us, and should not bear an undue burden of guilt.
Times, Sunday Times
He also spoke of living 'with the burden of guilt'.
Times, Sunday Times
The questions which troubled me afterwards were not just about the past and its burden of guilt.
Times, Sunday Times
He wants to lift the burden of guilt off your shoulders.
Christianity Today