[Top] [All Lists]

Re: [ontolog-forum] FW: Looking to the Future of Data Science - NYTimes.

To: ontolog-forum@xxxxxxxxxxxxxxxx
From: Kingsley Idehen <kidehen@xxxxxxxxxxxxxx>
Date: Tue, 02 Sep 2014 13:33:43 -0400
Message-id: <5405FF77.7030807@xxxxxxxxxxxxxx>
On 9/2/14 11:25 AM, Barkmeyer, Edward J wrote:

I regret to say, I think this definition is about buzzword maintenance.  The idea is clearly:  Big Data is about inventing a new information processing technology that will work better for datasets that RDB technology just can’t handle – “a paradigm shift” in technology. 


What is wanted is not a paradigm shift in processing technology – the last two paradigm shifts got us XML databases and XQuery and RDF triple stores, both of which are clumsy repositories that just make the Big Data problem more expensive. 


What is wanted (as Michael Brunnbauer hinted) is a paradigm shift in data acquisition mindset.  I will paraphrase some other contribution to this exploder, which I have since lost:  “If you don’t know what you have when you get it, you will never know it later.”  


There is a big difference between large volumes of data that must be maintained in order to perform a particular set of business or governmental functions and responsibilities, and large volumes of data that are available and might enable some analytical process that is at best desirable.  Amazingly enough, we have muddled through the support of the former for 50 years with established technologies and state of the art computational resources, and newer technologies have become established as the quality of the implementations and the resources for supporting them became able to carry the increasing load.  We have been able to do this by working around the limitations to deliver satisfactory, if less than ideal, services somehow.  As John Sowa and others have said, this is a recurring problem; it is not a new problem.


The problem we have is with our appetite.  There is so much information food out there that we could surely find the taste treats for the most discriminating palates if we could just search it all fast enough.  That is all very exciting, but it is irrelevant to solving the problem of delivering to everyone his daily information bread.  The problem is in focusing on what we need to process, not what we would like to process.  The people who are concerned about data they need to process in order to deliver adequate services and products are experiencing the 2014 version of the 1960 problem.  The rest are just blowing Big Data horns.


The would-be ISO definition fails to say: 

Big Data: a data set(s) with characteristics that for *a required function* at a given point in time cannot be efficiently processed using current/existing/established/traditional technologies and techniques in order to *provide adequate support for that function*.


It is not about an arbitrary “particular problem domain” or being able to “extract [some perceived] value”.   That is an academic view, and why we have research institutions.




Great addition to this evolving conversation. Naturally, I've incorporated your comments into the "Big Data" description that I am maintaining:

[1] http://linkeddata.uriburner.com/describe/?url=""> -- without the effect of owl:sameAs relation reasoning and inference

http://linkeddata.uriburner.com/describe/?url=""> -- with the effect of owl:sameAs relation semantics reasoning and inference

https://plus.google.com/112399767740508618350/posts/79nHeum5DQR -- how I am using G+ post based nanotations to fit the pieces of this puzzle together, as I encounter new and interesting insights

[4] https://plus.google.com/112399767740508618350/posts/MRsyNtqgTXz -- ditto in regards to comments by John Sowa .


[1] http://kidehen.blogspot.com/2014/07/nanotation.html -- about Nanotation
[2] https://twitter.com/kidehen/status/506813897043881984 -- Tweet related to paradigm shift re. data acquisition (i.e., RDF sentence based Nanotations that fit into place where text exists) .


Kingsley Idehen	      
Founder & CEO 
OpenLink Software     
Company Web: http://www.openlinksw.com
Personal Weblog 1: http://kidehen.blogspot.com
Personal Weblog 2: http://www.openlinksw.com/blog/~kidehen
Twitter Profile: https://twitter.com/kidehen
Google+ Profile: https://plus.google.com/+KingsleyIdehen/about
LinkedIn Profile: http://www.linkedin.com/in/kidehen
Personal WebID: http://kingsley.idehen.net/dataspace/person/kidehen#this

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

Message Archives: http://ontolog.cim3.net/forum/ontolog-forum/  
Config Subscr: http://ontolog.cim3.net/mailman/listinfo/ontolog-forum/  
Unsubscribe: mailto:ontolog-forum-leave@xxxxxxxxxxxxxxxx
Shared Files: http://ontolog.cim3.net/file/
Community Wiki: http://ontolog.cim3.net/wiki/ 
To join: http://ontolog.cim3.net/cgi-bin/wiki.pl?WikiHomePage#nid1J    (01)

<Prev in Thread] Current Thread [Next in Thread>