To kick oneself

Related to To kick oneself: kick up a fuss, kicking around
to experience strong regret; as, he kicked himself for not investing in the stock market in 1995.

See also: Kick