robertskmiles patreon

Early Access Video: Deceptive Misaligned Mesa-Optimisers? It's More Likely Than You Think...

🕑 Added 2021-05-22 20:01:00 +0000 UTC

Comments

Chris K

Ohbtw: what I always wanted to say: I am currently training a natural neuronal network and $all.this seems dreadfully close to it. NNN comes to dinner with dirty hands. Instruct to wash hands. NNN leaves room for half a second and claims completion. NNN is informed that this is preposterous and instructed to REALLY wash hands. NNN leaves room, short burst of water is heard, NNN returns with statement of success. NNN is informed that amount of water used is implausible with cleaning action. NNN leaves room begrudgingly and after audible cleaning returns, claims success. Inspection reveals that hands are still dirty because water without soap is not cleaning, but merely wetting. NNN is reminded of initial instructions to clean hands, which includes water AND soap. .... etc. Which kinda proves that we live in base-reality and not in a simulation because all code contains bugs. In a sim, at least one of the billion child-type-agents would have found said bugs to get around washing hands to satisfy the reward-function and get to dinner quicker. Maybe that is how they found out who to bring to the Oracle in The Matrix? Cheers! Chris :)