If politicians or other well-known people spend time in the wilderness, they are not in an influential position or very active in their profession for that time. [mainly British]
...a party released from 12 years in the wilderness.
For so long he had waited in the wilderness for a recall to Test cricket.