Discussion about this post

User's avatar
Olli Järviniemi's avatar

Really nice post (once again)! Bunch to chew on here.

There were many items where I thought "oh, I know you, nice to see you!" and liked seeing them explicitly laid down. Most clearly 15, 37 and 59.

There were many that I was familiar with before but which I internally phrase in very different ways. (I didn't see you use the word "probability" anywhere :).)

There were some that I definitely remember Not Getting when I was younger. Most clearly 76 (also 40) is exactly the type of thing that Wise Old People who have Seen Things say, something that "you'll understand when you are older", and which was never explained to me. In addition to 40 and 76, there's the "there are true things you cannot say publicly". (I think the examples of this young-me encountered were false things that you shouldn't say publicly for good reasons, which made me disregard concept.) I think I do understand those now.

There are lots and lots that I don't really get, which is of course what I should expect for a list of sazens.

---

Taking up on your challenge, here's a shot at listing some Important Lessons. There's overlap with many of yours. Some are well-established. I have written my take on the basics of rationality, where I elaborate on these. (No, you can't see them, as they are in Finnish.)

A) Distributions Are Wide and wider than many think. (Because of, uh, optimization, selective memory, filtered evidence, correlations, filter bubbles, ...) This is a basic point underlying lots of other concepts - e.g. I think of (parts of) your Social Dark Matter as building on top of this.

B) Isolated demands for rigor, proving too much, fully general counterarguments, symmetry-breaking arguments, invalid implication, Model of One Variable(TM) - these belong to the same cluster of things. This is what I understand Yudkowsky to be pointing at when he writes about local validity. https://www.lesswrong.com/posts/WQFioaudEH8R7fyhm/local-validity-as-a-key-to-sanity-and-civilization

C) Obvious advice are not obvious and are important. See: https://mindingourway.com/obvious-advice/. Obvious truths are also important. Many eye-rolling cliches, e.g. "correlation is not causation" or "social media forms filter bubbles", really are often ignored even when relevant (also by some of those who roll their eyes at them).

D) There's this thing where people round things off to the nearest cliche, the closest familiar-to-them idea or something easier-to-think-about. They paint with too wide of a brush. "Event A is more likely than event B" gets rounded off to "Event A will happen" (https://xkcd.com/2370/). A hard question is substituted for an easy one (https://en.wikipedia.org/wiki/Attribute_substitution). Things are Good or Bad (https://en.wikipedia.org/wiki/Halo_effect).

E) There's a tendency to attribute things to Evil People. Often more relevant issues are Moloch, Things Being Hard, incompetence, ...

F) Other People Think Too. Theory of mind. Cognitive Reflection Test. Intellectual Turing Test. Consider the hypothesis that the other person might have thought of that. Talk to the person, not your model of the person.

G) It is not on other people to convince you of true things. The phrase "That's not convincing" is a red flag, as is talk about "burden of proof".

H) There's this thing where people would predictably update in a given direction if they knew more about it. Maybe helpful example: I think many people who don't know much about atrocities of history, or specific parts of history, predictably update to "wow people did really, really bad things", as in advance as they don't have Certain Knowledge and wouldn't be able to Convincingly Argue for bad things having happened. However, often people have knowledge about the *type of things* that they don't know. (Related: absence of evidence is..., blank map doesn't corresponds to a blank territory, conservation of expected evidence.)

I) The Efficient World Hypothesis is false. It is possible for you to notice things being sub-optimal and see how they could be better. This is not a contradiction. (C.f. Moloch, Inadequate equilibria)

J) Relatedly, you can acknowledge that there is a problem even though you cannot see how it could be solved, or if it really is very difficult to solve.

K) The truth is important. (For some reason I'm tempted to remind the reader of point C, the part about many eye-rolling cliches being important.) So is ability to reason about the world.

Expand full comment
Jesper's avatar

Really nice post, thank you for listing these. There are a few of these that have come up recently in my life and that should really be on a tshirt or poster or something (both for my own benefit and for others), in particular #12, #13, #36, #47, #48, #51, #59, #63, and #77 resonated a lot.

Regarding suggestions for more ideas of this kind, I'm not quite sure what is the exact scope you are looking for but here are a few I think fit well:

- The whole Replacing Guilt sequence by Nate Soares (replacingguilt.com). Using guilt as a motivator is a trap that I see a lot of people around me fall into, and one of the main ways people seem to hurt themselves for basically no reason.

- People don't work as much as you think (https://drmaciver.substack.com/p/people-dont-work-as-much-as-you-think). Related to the above.

- You are probably underestimating how good self-love can be (https://www.lesswrong.com/posts/BfTW9jmDzujYkhjAb/you-are-probably-underestimating-how-good-self-love-can-be).

- A single creative project can change your life (https://fortelabs.com/blog/a-single-creative-project-can-change-the-trajectory-of-your-life/). About how expressing yourself creatively can have a profound and lasting impact on the way you view yourself and interact with the world.

- The classic advice to Keep Your Identity Small (https://paulgraham.com/identity.html) by Paul Graham. Not letting your identity be determined by any organization or group outside of your control is a really valuable skill to have.

- Sometimes people will protect themselves by setting themselves up for failure (https://articles.starcitygames.com/articles/stuck-in-the-middle-with-bruce/).

Expand full comment
7 more comments...

No posts