Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Locked thread
Inexplicable Humblebrag
Sep 20, 2003

Smythe posted:

my friend, begone of this thread. or perish

thanks for chasing off the anime retard, smythe

i picked up this Bostrom book from one of the usual NMN sci-fi thread cheap-book dumps and although it's kinda heavy going (still not finished it), it deals compellingly with the issues inherent in creating an artificial intelligence that has capacity for self-improvement. namely, how do we deal with a superintelligent, not-guaranteed-to-be-acting-in-our-best-interests entity?

Adbot
ADBOT LOVES YOU

Inexplicable Humblebrag
Sep 20, 2003

Well then why even bother

(This gets addressed too)

Inexplicable Humblebrag
Sep 20, 2003

really though the kill switch will either be internal or external. if it's internal it will have to trigger something in the mind of a superintelligent entity that can edit its own makeup (probably its code) and may be able to work around it (e.g. feed output from the killswitch into a VM)

if it's external then your security relies on humans doing the right thing when confronted with a superintelligent, possibly extremely persuasive, entity.

iirc there's like a chapter on this that goes into some actual detail. it's a good book

  • Locked thread