OntologySummit2013: Virtual Session-15 - Thu 2013-04-25    (3QOO)

Summit Theme: "Ontology Evaluation Across the Ontology Lifecycle"    (3QOP)

Session Topic: Pre-symposium preparation and review    (3QOQ)

Symposium Co-chairs: Dr. RamSriram (NIST) and Mr. MikeDean (Raytheon BBN)    (3RHC)

Archives:    (3RHD)

Conference Call Details    (3RHM)

Attendees    (3RIJ)

Abstract:    (3RJ6)

OntologySummit2013 Session-15: "Pre-symposium preparation and review" - materials    (3RJ7)

This is our 8th Ontology Summit, a joint initiative by NIST, Ontolog, NCOR, NCBO, IAOA & NCO_NITRD with the support of our co-sponsors. The theme adopted for this Ontology Summit is: "Ontology Evaluation Across the Ontology Lifecycle."    (3RJ8)

Currently, there is no agreed methodology for development of ontologies, and there are no universally agreed metrics for ontology evaluation. At the same time, everybody agrees that there are a lot of badly engineered ontologies out there, thus people use -- at least implicitly -- some criteria for the evaluation of ontologies.    (3RJ9)

During this OntologySummit, we seek to identify best practices for ontology development and evaluation. We will consider the entire lifecycle of an ontology -- from requirements gathering and analysis, through to design and implementation. In this endeavor, the Summit will seek collaboration with the software engineering and knowledge acquisition communities. Research in these fields has led to several mature models for the software lifecycle and the design of knowledge-based systems, and we expect that fruitful interaction among all participants will lead to a consensus for a methodology within ontological engineering. Following earlier Ontology Summit practice, the synthesized results of this season's discourse will be published as a Communique.    (3RJA)

At the Launch Event on 17 Jan 2013, the organizing team provided an overview of the program, and how we will be framing the discourse around the theme of of this OntologySummit. Much has happened since - by the end of this week, as a community, we would have run 15 virtual community sessions, built a community library, conducted a software survey, run seven hackathon and clinics projects, built a public facing website as well as a semantically-enabled wiki-site for our content, and are putting the best collective insight into our Communique.    (3RJB)

In this 15th virtual panel session of the Summit, the last of the virtual sessions, we will do a final review on everything, and prepare ourselves for the OntologySummit2013_Symposium, the two-day face-to-face event at NIST (Gaithersburg, Maryland, USA) on May 2~3 (i.e. next week) which this Summit will culminate in.    (3RJC)

More details about this OntologySummit is available at: OntologySummit2013 (homepage for this summit)    (3RJD)

Agenda:    (3RJE)

OntologySummit2013 - Virtual Session-15    (3RJF)

Proceedings:    (3RJN)

Please refer to the above    (3RJO)

IM Chat Transcript captured during the session:    (3RJP)

 see raw transcript here.    (3RJQ)
 (for better clarity, the version below is a re-organized and lightly edited chat-transcript.)
 Participants are welcome to make light edits to their own contributions as they see fit.    (3RJR)
 -- begin in-session chat-transcript --    (3RJS)
	[9:22] PeterYim: Welcome to the    (3ROX)
	 = OntologySummit2013: Virtual Session-15 - Thu 2013-04-25 =    (3ROY)
	Summit Theme: Ontology Evaluation Across the Ontology Lifecycle    (3ROZ)
	Session Topic: Pre-symposium preparation and review    (3RP0)
	* Session Co-chairs 
	- Dr. RamSriram (NIST) and Mr. MikeDean (Raytheon BBN)    (3RP1)
	Agenda:    (3RP2)
	1. Opening: OntologySummit2013_Symposium (co-chairs) - MikeDean & RamSriram [ref. symposium page]    (3RP3)
	2. Review of symposium agenda and status of preparation - symposium co-chairs and all speakers    (3RP4)
	3. Q & A and open discussion relating to the symposium - All    (3RP5)
	4. Q & A and open discussion relating to the any other pertinent issues - All    (3RP6)
	5. Status review / Follow-up actions - (co-chairs)    (3RP7)
	6. Announcements / Wrap Up - (co-chairs)    (3RP8)
	Logistics:    (3RP9)
	* Refer to details on session page at: http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2013_04_25    (3RPA)
	* (if you haven't already done so) please click on "settings" (top center) and morph from "anonymous" to your RealName (in WikiWord format)    (3RPB)
	* Mute control: *7 to un-mute ... *6 to mute    (3RPC)
	* Can't find Skype Dial pad?
	** for Windows Skype users: it may be under the "Call" dropdown menu as "Show Dial Pad"
	** for Linux Skype users: please note that the dial-pad is only available on v4.1 (or later or the earlier Skype versions 2.x,)
	if the dialpad button is not shown in the call window you need to press the "d" hotkey to enable it.    (3RPD)
	* Note: ... it has come to our attention that our conference bridge provider is running into some problems with the "joinconference" skype connections. 
	In case anyone gets in trouble, please try to call the phone numbers instead (e.g. from your phone, skype-out, google-voice, etc.)    (3RPE)
	Attendees: RamSriram (co-chair), MikeDean (co-chair), PeterYim (scribe), AmandaVizedom, 
	AstridDuqueRamos, DougFoxvog, FabianNeuhaus, KenBaclawski, LeoObrst, MatthewWest, MichaelGruninger, 
	MikeBennett, RodMorgan, SteveRay, TerryLongstreth, ToddSchneider, anonymous,    (3RPF)
	 == Proceedings: ==    (3RPG)
	[9:31] SteveRay: Indeed, Skype booted me off. Now on Google voice.    (3RPH)
	[9:34] anonymous morphed into RodMorgan (DOS)    (3RPI)
	[9:35] PeterYim: The Symposium homepage is at: 
	http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Symposium    (3RPJ)
	[9:40] PeterYim: RamSriram: need to finalize on keynote speakers 2 & 3    (3RPK)
	[9:41] PeterYim: MikeDean: will need to finalize on place to do the May-2 group dinner too    (3RPL)
	[9:42] ToddSchneider: (ref. comments on the Dogfish Ale House across the street from the NIST campus 
	where we have had group dinners before) I prefer my fish cooked.    (3RPM)
	[9:45] MichaelGruninger: Kent State University is sponsoring deluxe box lunches on May 2    (3RPN)
	[9:46] PeterYim: RamSriram: I will sit down with FabianNeuhaus to go over the logistic details later 
	today ... Steve will be in town on May-1 and can come over and check the place out    (3RPO)
	[9:50] PeterYim: look at registrants: 
	(on-site): http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013/WorkshopRegistration#nid3P45 ... 
	(remote): http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013/WorkshopRegistration#nid3P34    (3RPP)
	[9:52] AmandaVizedom: I had a connection problem and dropped off at around 12:40; just back.    (3RPQ)
	[9:54] AmandaVizedom: Please let me know if I missed any items of particular relevance to me, 
	communique, or hackathon outputs. Sorry, and thanks.    (3RPR)
	[9:56] PeterYim: RamSriram: [agreed among the chairs] in the openings - the symposium chairs will be 
	handling the logistics and formalities, and the general chairs will focus on the content side of 
	things, and provoke thoughts from the participants    (3RPS)
	[9:57] AmandaVizedom: IIRC, last week we also agreed that it might be especially useful if Track 
	discussion/ questions picked up on issues from the track that fell outside the narrower scope of the 
	Communique.    (3RPT)
	[9:59] MatthewWest: Sorry I'm late.    (3RPU)
	[9:59] AmandaVizedom: I don't think we should be looking to raise *all* of Pat's issues - some of 
	them are counters to claims we are not making, and have made clearer that we are not making, yes?    (3RPV)
	[10:00] SteveRay: Agreed.    (3RPW)
	[10:01] TerryLongstreth: We're talking about a dialogue with PatHayes, but I don't think I'm 
	receiving those notes. Can someone point me to a thread in the Msg archives?    (3RPX)
	[10:02] PeterYim: @Terry and all - see thread starting 
	http://ontolog.cim3.net/forum/ontology-summit-advisors/2013-04/msg00001.html    (3RPY)
	[10:03] TerryLongstreth: Thanks Peter. I'm not on the advisors list    (3RPZ)
	[10:05] ToddSchneider: Track B can use one of the three questions to raise the question of how 
	requirements fits into a development methodology.    (3RQ0)
	[10:08] PeterYim: Fabian will tell PatHayes that we will bring up some of his issues in the Track-C 
	discussion ... (and see if he might join us)    (3RQ1)
	[10:11] PeterYim: @All symposium speakers - again, slides are due end-of-day Monday Apr-29    (3RQ2)
	[10:17] MikeBennett: Lifecycle: there may be an assumption in some quarters that there is "one" 
	lifecycle for ontologies, whereas what we have explored and uncovered is the range of lifecycle 
	considerations for ontologies, e.g. where a business conceptual ontology fits into a lifecycle for    (3RQ3)
	[10:19] AmandaVizedom: I would appreciated it if Org Comm members take a peek at the rewritten 
	section "An Ontology Life Cycle Model" to see whether we have addressed these concerns already, and 
	to tell us if something is still problematic.    (3RQ4)
	[10:19] AmandaVizedom: The (still under revision) draft is here: 
	https://docs.google.com/document/d/1jeU5DL9JuNiyxv7BDOMr0VgFIWmSKVHXcnLlcHF-Zg0/edit?usp=sharing    (3RQ5)
	[10:25] MikeBennett: Since people may already be using several methodologies / methods which are 
	already in place, the lifecycle considerations for ontology development must be seen to be able to 
	fit into whatever methods are in play.    (3RQ6)
	[10:26] MikeBennett: I think the re-write reads well, though it still reads as though one specific 
	deployment scenario is in play (ontology included in some information system). I think that's broad 
	enough to cover everything an ontology might be used for (what about ontologies as industry 
	standards). Some narrative setting out the range of deployment scenarios which this is intended to 
	cover, would help.    (3RQ7)
	[10:30] TerryLongstreth: @Mike - I think you meant "...that's NOT broad enough..." . I agree with 
	your conclusion.    (3RQ8)
	[10:32] MikeBennett: @Terry I was trying to convince myself it was broad enough, but it depends on 
	what's meant by "information systems", which would need to be developed in the narrative. And my 
	counter-example of ontologies as standards works against this.    (3RQ9)
	[10:35] MatthewWest: But the standards are then incorporated in Information Systems. It is just that 
	the standard ontology is just part of the information system lifecycle.    (3RQA)
	[10:38] MikeBennett: @Matthew fair enough. So the question is, does the revised narrative cover the 
	full range of ways in which ontologies may fit into the different lifecycles of different systems in 
	which they may deliver some benefit?    (3RQB)
	[10:39] MatthewWest: Probably not, but I do not think we are claiming completeness, just an initial go    (3RQC)
	[10:35] ToddSchneider: Have to go. Cheers.    (3RQD)
	[10:37] PeterYim: we are doing reasonably well in the survey. Survey responses can be seen at: 
	http://ontolog-02.cim3.net/wiki/Category:OntologySummit2013_Survey    (3RQE)
	[10:37] TerryLongstreth: @Mike - in our 'Track-B' panel sessions, we've discussed the evaluation 
	from a systems perspective, but I'm not convinced that the idea of an ontology built to requirements    (3RQF)
	[10:39] PeterYim: MikeDean: people who will be organizing ad hoc gatherings for the BOF slot (May 3 
	3:30~5:00pm) should post to the agenda and post something to the [ontology-summit] list so everyone 
	would know, and come participate    (3RQG)
	[10:37] AmandaVizedom: I plan to use the BOF session to touch base with folks about continuing work 
	on the ontology of ontology evaluation (from HC-05). I will send a message to this effect to the 
	summit discussion list.    (3RQH)
	[10:42] PeterYim: there will not be an organizing committee meeting tomorrow Fri Apr-26    (3RQI)
	[10:43] PeterYim: people who arrives early into Gaithersburg are welcome to have dinner together on    (3RQJ)
	[10:44] PeterYim: good meeting!    (3RQK)
	[10:44] PeterYim: -- session ended: 10:44am PDT --    (3RQL)
 -- end of in-session chat-transcript --    (3RJT)

Additional Resources:    (3RK0)

For the record ...    (3RK9)

How To Join (while the session is in progress)    (3RKA)