Hello Philip, (01)
On Sat, Sep 06, 2014 at 06:02:47PM -0400, Philip Jackson wrote:
> MB:
> > I am just suggesting that having goals implies self-preservation. You quoted
> > someone saying that AIs need not have self-preservation instinct.
>
> I am suggesting that having goals does not necessarily imply
>self-preservation. (02)
Not necessarily, yes. (03)
> The self-preservation instinct is very important to humans, so important that
>people may think having goals implies self-preservation. Yet there is not such
>a logical implication. (04)
That depends on how you formulate the goals. A human-level AI will probably
not even care if it's a logical implication. (05)
> Maybe all you do is give the system a target date, and ask it to try to write
>a paper on a certain problem by the target date. (06)
What if you change your mind and it learns of this? That this is a threat
to the goal could be a valid logical conclusion. (07)
> The system's abilities to act, or not act physically, could be what prevents
>it from doing something harmful to people. (08)
If you have to use such provisions, the AI is already uncontrollable - in a
sense. (09)
Regards, (010)
Michael Brunnbauer (011)
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@xxxxxxxxxxxx
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel (012)
pgppsPnD5WW5P.pgp
Description: PGP signature
_________________________________________________________________
Message Archives: http://ontolog.cim3.net/forum/ontolog-forum/
Config Subscr: http://ontolog.cim3.net/mailman/listinfo/ontolog-forum/
Unsubscribe: mailto:ontolog-forum-leave@xxxxxxxxxxxxxxxx
Shared Files: http://ontolog.cim3.net/file/
Community Wiki: http://ontolog.cim3.net/wiki/
To join: http://ontolog.cim3.net/cgi-bin/wiki.pl?WikiHomePage#nid1J (01)
|