I've read a SF story like this once, woth effectively a caste of space going pilots and scientists that spend most of their time in cryosleep on board of ships going at relativistic speeds, exploring the universe and starting colonies.
As long as they don't have relations with normal humans outosde the caste they live quite normal lives, meeting their friends from the caste relativity often from subjective PoV, with potentially decades or centuries going one between such encounters.
Still if you say want to settle down and have children, you won't likely wont see anyone else from the caste ever again as the next time one of your friends ventures to the system you settled in they will only encounter your descendants, possibly a couple generations after your time.
As long as they don't have relations with normal humans outosde the caste they live quite normal lives, meeting their friends from the caste relativity often from subjective PoV, with potentially decades or centuries going one between such encounters.
Still if you say want to settle down and have children, you won't likely wont see anyone else from the caste ever again as the next time one of your friends ventures to the system you settled in they will only encounter your descendants, possibly a couple generations after your time.