[Top] [All Lists]

Re: [ontolog-forum] Future Consequences of AI and Automation

To: "[ontolog-forum] " <ontolog-forum@xxxxxxxxxxxxxxxx>
From: Michael Brunnbauer <brunni@xxxxxxxxxxxx>
Date: Sun, 7 Sep 2014 01:46:29 +0200
Message-id: <20140906234629.GA3444@xxxxxxxxxxxx>

Hello Philip,    (01)

On Sat, Sep 06, 2014 at 06:02:47PM -0400, Philip Jackson wrote:
> MB: 
> > I am just suggesting that having goals implies self-preservation. You quoted
> > someone saying that AIs need not have self-preservation instinct.
> I am suggesting that having goals does not necessarily imply 
>self-preservation.    (02)

Not necessarily, yes.    (03)

> The self-preservation instinct is very important to humans, so important that 
>people may think having goals implies self-preservation. Yet there is not such 
>a logical implication.    (04)

That depends on how you formulate the goals. A human-level AI will probably
not even care if it's a logical implication.    (05)

> Maybe all you do is give the system a target date, and ask it to try to write 
>a paper on a certain problem by the target date.    (06)

What if you change your mind and it learns of this? That this is a threat
to the goal could be a valid logical conclusion.    (07)

> The system's abilities to act, or not act physically, could be what prevents 
>it from doing something harmful to people.    (08)

If you have to use such provisions, the AI is already uncontrollable - in a
sense.    (09)

Regards,    (010)

Michael Brunnbauer    (011)

++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@xxxxxxxxxxxx
++  http://www.netestate.de/
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel    (012)

Attachment: pgppsPnD5WW5P.pgp
Description: PGP signature

Message Archives: http://ontolog.cim3.net/forum/ontolog-forum/  
Config Subscr: http://ontolog.cim3.net/mailman/listinfo/ontolog-forum/  
Unsubscribe: mailto:ontolog-forum-leave@xxxxxxxxxxxxxxxx
Shared Files: http://ontolog.cim3.net/file/
Community Wiki: http://ontolog.cim3.net/wiki/ 
To join: http://ontolog.cim3.net/cgi-bin/wiki.pl?WikiHomePage#nid1J    (01)

<Prev in Thread] Current Thread [Next in Thread>