If you say that someone's heart is in the right place, you mean that they are kind, considerate, and generous, although you may disapprove of other aspects of their character.