{"id":178,"date":"2011-12-29T13:07:06","date_gmt":"2011-12-29T21:07:06","guid":{"rendered":"http:\/\/facingthesing.wpengine.com\/?p=178"},"modified":"2014-12-06T14:47:42","modified_gmt":"2014-12-06T22:47:42","slug":"dont-flinch-away","status":"publish","type":"post","link":"https:\/\/intelligenceexplosion.com\/sv\/2011\/dont-flinch-away\/","title":{"rendered":"Rygga inte tillbaka"},"content":{"rendered":"

Tyv\u00e4rr \u00e4r denna artikel enbart tillg\u00e4nglig p\u00e5 English<\/a>, Fran\u00e7ais<\/a>, \u0440\u0443\u0441\u0441\u043a\u0438\u0439<\/a>, Sloven\u010dina<\/a>, \u4e2d\u6587<\/a> och Italiano<\/a>.<\/p>

P<\/span>erhaps you\u2019ve heard of the Japanese holdouts<\/a> who refused to believe the reports of Japan\u2019s surrender in 1945. One of them was Lt. Hiroo Onoda<\/a>, who was in charge of three other soldiers on the island of Lubang in the Philippines. For more than a decade they lived off coconuts and bananas in the jungle, refusing<\/a> to believe the war was over:<\/p>\n

Leaflet after leaflet was dropped. Newspapers were left. Photographs and letters from relatives were dropped. Friends and relatives spoke out over loudspeakers. There was always something suspicious, so they never believed that the war had really ended.1<\/sup><\/a><\/a><\/p><\/blockquote>\n

One by one, Onoda\u2019s soldiers died or surrendered, but Onoda himself wasn\u2019t convinced of Japan\u2019s surrender until 1974, nearly thirty years after the war had ended. Later, he recalled<\/a>:<\/p>\n

Suddenly everything went black. A storm raged inside me. I felt like a fool. . . . What had I been doing for all these years?2<\/sup><\/a><\/a><\/p><\/blockquote>\n

The student of rationality<\/a> wants true beliefs, so that she can better achieve her goals. She will respond to evidence very differently than Onoda did. She will change her mind as soon as there is enough evidence to justify doing so (according to what she knows already and the laws<\/a> of probability theory). Holding on to false beliefs can have serious consequences: say, thirty years of pooping in coconut shells.<\/p>\n

Onoda had been trained under the kind of militaristic dogmatism that creates kamikaze pilots, and he had been made to believe that Japanese defeat was the worst outcome imaginable. Thus, he naturally flinched away from evidence that Japan had lost the war, for he was trained to believe this outcome was emotionally and mentally unthinkable.<\/p>\n

One of the skills in the toolkit of rational thought is to notice when this \u201cflinching away\u201d happens and counteract it. We will need this skill as we begin to look at the implications of the ideas we\u2019ve just discussed\u2014that AI is inevitable<\/a> if scientific progress continues, and that AI can be much<\/em> more intelligent<\/a> (and therefore more powerful) than humans are. When we examine the implications of these ideas, it will be helpful to understand what happens in human brains when they consider ideas with unwelcome implications. As we\u2019ll see, it doesn\u2019t take military indoctrination for the human brain to flinch away. In fact, flinching away is a standard feature of human psychology and goes by names like \u201cmotivated cognition<\/a>\u201d and \u201crationalization<\/a>.\u201d<\/p>\n

As an extreme example, consider the creationist. He will accept dubious evidence for his own position, and be overly skeptical of evidence against it. He\u2019ll seek out evidence that might confirm<\/em> his position, but won\u2019t seek out the strongest evidence against it<\/a>. (Thus I encounter creationists who have never heard of endogenous retroviruses<\/a>.)<\/p>\n

Most of us do things like this<\/a> every week in (hopefully) less obvious and damaging ways. We flinch away from uncomfortable truths and choices<\/a>, saying, \u201cIt\u2019s better to suspend judgment.\u201d We avoid our beliefs\u2019 real weak points<\/a>. We start with a preconceived opinion<\/a> and come up with arguments for it later<\/a>. We unconsciously filter<\/a> our available evidence so as to favor our current beliefs. We rebut weak arguments against our positions, and don\u2019t try to consider the strongest possible arguments<\/a> against our positions.<\/p>\n

And usually these processes are automatic and subconscious. You don\u2019t have to be an especially irrational person to flinch away like this. No, you\u2019ll tend to flinch away by default without even noticing it<\/em>, and you\u2019ll have to exert conscious mental effort in order to not<\/em> flinch away from uncomfortable facts. And I don\u2019t mean chanting, \u201cDo not commit confirmation bias. Do not commit confirmation bias. . . .\u201d I mean something more effective.<\/p>\n

What kinds of conscious mental effort can you exert to counteract the \u201cflinching away\u201d response?<\/p>\n

One piece of advice is to leave yourself a line of retreat<\/a>:<\/p>\n

Last night I happened to be conversing with [someone who] had just declared (a) her belief in souls and (b) that she didn\u2019t believe in cryonics<\/a> because she believed the soul wouldn\u2019t stay with the frozen body. I asked, \u201cBut how do you know that?\u201d From the confusion that flashed on her face, it was pretty clear that this question had never occurred to her. . . .<\/p>\n

\u201cMake sure,\u201d I suggested to her, \u201cthat you visualize what the world would be like if there are no souls, and what you would do about that. Don\u2019t think about all the reasons that it can\u2019t be that way, just accept it as a premise and then visualize the consequences. So that you\u2019ll think, \u2018Well, if there are no souls, I can just sign up for cryonics,\u2019 or \u2018If there is no God, I can just go on being moral anyway,\u2019 rather than it being too horrifying to face. As a matter of self-respect you should try to believe the truth no matter how uncomfortable it is . . . [and] as a matter of human nature, it helps to make a belief less uncomfortable before you try to evaluate the evidence for it.\u201d<\/p><\/blockquote>\n

Of course, you still need to weigh the evidence fairly<\/a>. There are beliefs that scare me which I still reject, and beliefs that attract me which I still accept. But it\u2019s important to visualize a scenario clearly and make it less scary so that your human brain can more fairly assess the evidence on the matter.<\/p>\n

Leaving a line of retreat is a tool to use before<\/em> the battle. An anti-flinching technique for use during<\/em> the battle is to verbally call out the flinching reaction. I catch myself thinking things like \u201cI think I read that sugar isn\u2019t actually all that bad for us,\u201d and I mentally add, \u201cbut that could just be motivated cognition, because I really want to eat this cookie right now.\u201d<\/p>\n

This is like pressing pause<\/em> on my decision-making module, giving me time to engage my \u201ccuriosity modules,\u201d which are trained to want to know what\u2019s actually true<\/em> rather than to justify eating cookies. For example, I envision what could go badly if I came to false beliefs on the matter\u2014due to motivated cognition or some other thinking failure. In this case, I might imagine gaining weight or having lower energy in the long run as possible consequences of being wrong about the effects of sugar intake. If I were considering whether to buy fire insurance, I would imagine what might happen if I were wrong about my intuitive judgment on whether to buy the insurance.<\/p>\n

These tools will be important when we consider the implications of AI. We\u2019re about to talk about some heavy shit, but remember: Don\u2019t flinch away. Look reality in the eye and don\u2019t back down.<\/p>\n

* * *<\/p>\n

1<\/sup><\/a><\/a>Jennifer Rosenberg,\u00a0\u201cThe War is Over . . . Please Come Out,\u201d About.com, accessed November 10, 2012, http:\/\/history1900s.about.com\/od\/worldwarii\/a\/soldiersurr.htm<\/a>.<\/small><\/p>\n

2<\/sup><\/a><\/a>Hiroo Onoda, No Surrender: My Thirty-Year War<\/em>, 1st ed., trans. Charles S. Terry (New York: Kodansha International, 1974).<\/small><\/p>","protected":false},"excerpt":{"rendered":"

Tyv\u00e4rr \u00e4r denna artikel enbart tillg\u00e4nglig p\u00e5 English, Fran\u00e7ais, \u0440\u0443\u0441\u0441\u043a\u0438\u0439, Sloven\u010dina, \u4e2d\u6587 och Italiano.erhaps you\u2019ve heard of the Japanese holdouts who refused to believe the reports of Japan\u2019s surrender in 1945. One of them was Lt. Hiroo Onoda, who was… continue reading<\/a> »<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[4],"tags":[],"class_list":["post-178","post","type-post","status-publish","format-standard","hentry","category-chapter"],"_links":{"self":[{"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/posts\/178","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/comments?post=178"}],"version-history":[{"count":0,"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/posts\/178\/revisions"}],"wp:attachment":[{"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/media?parent=178"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/categories?post=178"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/intelligenceexplosion.com\/sv\/wp-json\/wp\/v2\/tags?post=178"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}