I genuinely don't think people that went to Exeter and Harvard (or MIT or Stanford or Penn or other JS feeder schools) see the rest of us as human unless there's another common factor like being employed by Jane Street and having those quirky hobbies the rest of them do - and then they rationalize it away by saying that the exceptions didn't apply to top schools, or were admitted but didn't attend for "financial reasons".
I interact with those people regularly without having the same background as them and this has basically never been the case. I think you've just been talking to horrible people.
People like me are "NPCs" in their parlance.