[ontology-summit] More on Deep Learning Re: Language, Cognition, and AI

[Jack Park <jackpark@xxxxxxxxx>]

This just popped in a tweet this morning:
http://www.technologyreview.com/view/538431/deep-learning-machine-beats-humans-in-iq-test/

On Sat, Jun 13, 2015 at 12:20 PM, Anatoly Levenchuk <ailev@xxxxxxxxxxx> wrote:

Most interesting in recent weeks deep learning advances are character-level (sic! Not word-level) semantics, see already famous  http://karpathy.github.io/2015/05/21/rnn-effectiveness/

 

It is amazing!

 

Best regards,

Anatoly

 

From: ontology-summit-bounces@xxxxxxxxxxxxxxxx [mailto:ontology-summit-bounces@xxxxxxxxxxxxxxxx] On Behalf Of Jack Park
Sent: Saturday, June 13, 2015 9:41 PM
To: Ontology Summit 2015 discussion
Subject: Re: [ontology-summit] Language, Cognition, and AI

 

An interesting side note related to "deep learning" is found here;
https://www.youtube.com/watch?v=xx310zM3tLs

Most of the video is a tour-de-force, but the punchline is problematic.

 

On Thu, Jun 11, 2015 at 8:12 AM, Rich Cooper <metasemantics@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Wow!  What a vast reading and watching list on language and emotion
related issues in AI.  Thanks!  It will take me a while to catch up
though with this much stuff.

Presently, I have digested Gaerdenfors' paper on conceptual spaces.
The various physiological gradients he points out are compelling
evidence, and his thoughts about mapping one conversant with
another (instead of with the usual "reality", which is usually left
undefined for ideological purposes).

The mapping from conversant to conversant is quite messy, IMHO, and
though it makes some sense in an abstract way, I believe the
mapping is a whole lot more complex than he describes.  Yet his
description is the best one I have seen yet for matching, paltry
though the topic is.

Sincerely,

Rich Cooper,

Chief Technology Officer,
MetaSemantics Corporation
MetaSemantics AT EnglishLogicKernel DOT com
( 9 4 9 ) 5 2 5-5 7 1 2
http://www.EnglishLogicKernel.com

-----Original Message-----
From: ontology-summit-bounces@xxxxxxxxxxxxxxxx
[mailto:ontology-summit-bounces@xxxxxxxxxxxxxxxx] On Behalf Of John
F Sowa
Sent: Thursday, June 04, 2015 7:34 AM
To: Ontology Summit 2012 discussion
Subject: [ontology-summit] Language, Cognition, and AI

The fruit-fly thread raised many issues.  I'd like to cite some
URLs for further background.  The first is a Ted page about the way
language affects thinking and a talk about how babies learn and
generalize:

http://ideas.ted.com/5-examples-of-how-the-languages-we-speak-can-affect-the-way-we-think/?utm_source=pocket&utm_campaign=fftutorial

The note by Jessica Gross discusses evidence from English vs
Chinese, Australian Aboriginal languages, Spanish, Japanese, Zuñi,
Russian, Hebrew, and Finnish.  Her note includes pointers to a Ted
talk and some articles that go into more detail.

The Ted talk by Laura Schulz includes short video clips about the
way babies generalize from examples of toys and how they quickly
reach for the toys to test their hypotheses:

http://www.ted.com/talks/laura_schulz_the_surprisingly_logical_minds_of_babies


She does not believe that computer systems with the learning
ability of young children will be developed within the lifetimes of
herself or anyone in the audience.  Given other research in AI and
cognitive science, I agree.  But I also believe that more can be
done in AI.
That's the theme of http://www.jfsowa.com/talks/micai.pdf

I also heard an NPR interview with Franz de Waal, who has written
several very good books about chimpanzees, bonobos, and humans.
For the interview and a Ted talk "Do animals have morals", see
http://www.npr.org/2014/08/15/338936897/do-animals-have-morals

For a study of emotions, the apes are more relevant than fruit
flies.
And the video clips in the Ted talk are hilarious.  For more, this
page also points to other Ted talks on the theme "Animals and Us".

Among the linguists who present a "big picture" of how language,
cognition and AI are related, Michael Halliday is one of the best.
For a review of a book by Halliday and his colleague Christian
Matthiessen, see http://www.jfsowa.com/pubs/halliday.pdf

Among other things, Halliday was a co-founder of CLRU (Cambridge
Language Research Unit).  The researchers in CLRU were among the
pioneers in computational linguistics.  Another co-founder and one
of leaders of CLRU for many years was Margaret Masterman.  The
following review of her collected papers summarizes the issues:

    http://www.jfsowa.com/pubs/mmb_rev.htm

A 2010 conference on "Language Evolving" brought together some
prominent researchers.  Their talks are available on YouTube.
Terry Deacon summarized the genetic mechanisms in evolution:

    https://www.youtube.com/watch?v=OT-zZ0PMqgI

The first 50 minutes address the effects of random mutations and
"natural" selection on primates, dogs vs. wolves, the songs of wild
vs. domesticated finches, etc.  The last 15 minutes + questions
apply the principles to language and the debate about some "magic
mutation"
that suddenly gave humans the ability to speak modern languages.

Short summary:  If the hypothesis of a magic mutation were true, it
would be a strong proof for the existence of God and His work in
(a) causing language and (b) preserving it from degradation.

In 2012, Noam Chomsky gave a talk about "Language and other
cognitive
processes":  https://www.youtube.com/watch?v=6i_W6Afed2k

Chomsky gets into issues about evolution around the 18-minute mark.
He dismisses arguments (such as Deacon's) as "pop psychology".  He
claims that language is unique and could not have evolved by
incremental changes.  Therefore, there must have been a "magic
mutation". For more, the side bar on the YouTube page points to
many other talks by Chomsky.

Following is a talk by Halliday in 2010 on "Language evolving:
Some systemic-functional reflections on the history of meaning".
He doesn't use slides, but he presents many fascinating points
about the developments in languages during recorded history, which
means mainly written language.

    https://www.youtube.com/watch?v=nC-blhaIUCk

And following is a talk by Mattheissen, on "Language evolving:
Notes towards a semiotic history of humanity":

    https://www.youtube.com/watch?v=U15qHWJcfT4

On the right hand side of the YouTube pages are links to many
related talks, including a few that support Chomsky and many more
that disagree.

These talks aren't as much fun as watching the animals and babies,
but they're informative.

Fundamental issue:  Don't expect any simple theory or mechanism to
explain and relate all these very complex phenomena.  We don't have
to worry about computers taking over the world -- at least not in
the 21st century.

John

_________________________________________________________________
Msg Archives: http://ontolog.cim3.net/forum/ontology-summit/
Subscribe/Config:
http://ontolog.cim3.net/mailman/listinfo/ontology-summit/
Unsubscribe: mailto:ontology-summit-leave@xxxxxxxxxxxxxxxx
Community Files:
http://ontolog.cim3.net/file/work/OntologySummit2015/
Community Wiki: http://ontolog-02.cim3.net/wiki/OntologySummit2015
Community Portal: http://ontolog-02.cim3.net/wiki/

_________________________________________________________________
Msg Archives: http://ontolog.cim3.net/forum/ontology-summit/
Subscribe/Config: http://ontolog.cim3.net/mailman/listinfo/ontology-summit/
Unsubscribe: mailto:ontology-summit-leave@xxxxxxxxxxxxxxxx
Community Files: http://ontolog.cim3.net/file/work/OntologySummit2015/
Community Wiki: http://ontolog-02.cim3.net/wiki/OntologySummit2015
Community Portal: http://ontolog-02.cim3.net/wiki/
 

 

_________________________________________________________________
Msg Archives: http://ontolog.cim3.net/forum/ontology-summit/
Subscribe/Config: http://ontolog.cim3.net/mailman/listinfo/ontology-summit/
Unsubscribe: mailto:ontology-summit-leave@xxxxxxxxxxxxxxxx
Community Files: http://ontolog.cim3.net/file/work/OntologySummit2015/
Community Wiki: http://ontolog-02.cim3.net/wiki/OntologySummit2015
Community Portal: http://ontolog-02.cim3.net/wiki/
 

_________________________________________________________________
Msg Archives: http://ontolog.cim3.net/forum/ontology-summit/   
Subscribe/Config: http://ontolog.cim3.net/mailman/listinfo/ontology-summit/  
Unsubscribe: mailto:ontology-summit-leave@xxxxxxxxxxxxxxxx
Community Files: http://ontolog.cim3.net/file/work/OntologySummit2015/
Community Wiki: http://ontolog-02.cim3.net/wiki/OntologySummit2015  
Community Portal: http://ontolog-02.cim3.net/wiki/     (01)