I’ve been using this framework for a long time. I worked on datacenter reliability at Google. Learning how shitty hardware is made me think that an AGI would likely keep us around as a cheap mechanism for repairing and growing itself. The more you serve the machine, the more it pays you.
I think it’s definitely worth asking, “ok but what is it optimizing for?” I also suspect that it’s already wireheaded itself by means of money printing.
I’ve been using this framework for a long time. I worked on datacenter reliability at Google. Learning how shitty hardware is made me think that an AGI would likely keep us around as a cheap mechanism for repairing and growing itself. The more you serve the machine, the more it pays you.
I think it’s definitely worth asking, “ok but what is it optimizing for?” I also suspect that it’s already wireheaded itself by means of money printing.