to drop the ball

to fail to perform as expected; to fail to live up to a responsibility.

See also: Ball