You use 'I grant you' or 'I'll grant you' to say that you accept something is true, even though your opinion about it does not change.
He took a risk, I'll grant you. But when you think about it, the risk was prettysmall.
I grant you that there have been excesses here and there.