If two people are holding hands, they are holding each other's nearest hand, usually while they are walking or sitting together. People often do this to show their affection for each other.
She approached a young couple holding hands on a bench.
[Also + with]