I'm an only child of two socially-minded academics. They basically taught me that we were smarter than most everybody else. That, of course, has lots of things wrong with it, but it did teach me to not care much about what other people think. In middle school and high school, I went through periods where I tried to fit in, but I always knew that it was more of an effort for me than for other kids. At 18, I stopped trying.
