This is one of the "OntologySummit2013_Hackathon_Clinics" Projects ... (3PH0)
Hackathon Project (HC-05): Ontology of Ontology Evaluation (3PH1)
Project Co-champions: AmandaVizedom, AliHashemi, (3PH2)
Event Date / Time: (Day-1) Sat 2013.03.30; optionally extending to Sun 2013.03.31 ... see: [ details] (3PH3)
Archived work output can be found here (3R5E)
Participant Volunteers: (3PRZ)
Add your name below, along with any time constraints or other participation-related comments. Thank you! (3PS1)
- AliHashemi (3PS3)
- AmandaVizedom (3PS4)
- JoelBender - joining late (3PS0)
- DavidWhitten (3Q0L)
- BobSmith (3Q10)
- PavithraKenjige (3Q11)
- PeterYim (3Q2S)
- MikeDean (3Q2T)
- YuLin (3Q38)
Updated Logistical Details (3PZ6)
This wiki page will be the go-to place for the most current and accurate information; any additional channels used or sub-events scheduled will be listed here. (3PZ7)
Update after close of session, Sunday, 2013-Mar-31: We have a variety of action items to follow up on, as captured in the chat transcript. For the moment, I (Amanda) am changing the Google docs to read only, mostly to avoid confusing folks who may follow these links and expect new edits to the docs to be read and/or incorporated. The end-of-day files have also been saved, by Peter, to the shared web-dav workspace (and that is where new output should go). (3Q39)
Update for Sunday, 2013-Mar-31: We will meet at 10 am, probably for 3 hrs or so. Audio via usual teleconference bridge, supplied by Peter (confirmed). Continuing to review, consolidate, and finalize the conceptual model spread across the comments in https://docs.google.com/drawings/d/1l3nc_lJgNlD1lGDY1kN7DbvzbYBZMfkn12l1_r_RIU4/edit?usp=sharing (currently view only) and the various subdiagrams in the https://drive.google.com/folderview?id=0B_5lZBgIG6LRQnZSdUFWX2FnYTg&usp=sharing shared Google drive (currenly editable by anyone with the URL). (3Q2U)
- primary project contact: AmandaVizedom (3PZ8)
- Activities will be in session: (3PZ9)
- Open webcast segment (3PZG)
- Project chat-room (up when in session): http://webconf.soaphub.org/conf/room/hc-05 (3PZM)
- Currently there are no plans to use subgroup chat rooms, but if that changes in-session, such subgroup chat-room will be designated (using ../room/hc-05-1 ; ../room/hc-05-2 etc.), announced in the main chat, and listed here on the project wiki page. (3PZN)
- Live Collaboration and Shared files: (3PZO)
- Google Drive: https://drive.google.com/folderview?id=0B_5lZBgIG6LRQnZSdUFWX2FnYTg&usp=sharing (3Q25)
- This is a shared Google Drive, set to be viewable and editable by anyone with the URL. (3Q26)
- It is recommended, though not required, that participants explicitly add themselves as editors, so that they can easily find files and, if they are Google drive users, have synced copies of the drive and all files ready-to-hand. (3Q27)
- All editors and viewers of any file in the drive can see who else is working in it and what they are doing, in real time. This supports our real-time collaborative editing goals. (3Q28)
- Finished files (and periodic checkpoints, if desired) can be upload to shared static file share work space supported by cim. (3Q29)
- Update: we exceeded Google Hangout limit (10 people) on Saturday, but were able to use the teleconference bridge for the remainder of our time. We will also be able to use the bridge on Sunday. (3Q2V)
- Google Hangout: (3Q2A)
- https://plus.google.com/hangouts/_/3d1cd01a02408d4c916035cc8377851ba13d9035?pqs=1&authuser=0&hl=en (3Q2G)
- We will use Google Hangout to add audio/video, screensharing, chat, etc. (3Q2B)
- Drive files and collaboration can be viewed within the hangout in a single browser window, which may simplify the collaboration process. (3Q2C)
- Tools for development activities (3Q01)
- (3Q2F)
- Formal representation (day 2): (3Q09)
- This will depend in part on the characteristics of the resulting conceptual model. A representation language that is appropriate to that model will be chosen by participants. Tools for that language, available to all participants, will then be selected for day 2 work. (3Q0A)
- Formal representation (day 2): (3Q09)
- References and Sources Materials: (3PZV)
- This wiki: OntologySummit2013 presentation and discussion materials (3PZW)
- Shared library (hosted on Zotero, team editable) for the summit community: https://www.zotero.org/groups/ontologysummit2013/items/ (3PZX)
- Shared library sub-collection for this hackathon: https://www.zotero.org/groups/ontologysummit2013/items/collectionKey/PVGF24A6 (3PZY)
Abstract (3PI0)
The 2013 Ontology Summit is bringing together a rich range of perspectives on ontology evaluation. Some of these perspectives are fairly abstract, some are encoded in methods and practices, and some are encoded in tools. Critical interaction via summit sessions and discussion has resulted in greater sharing of knowledge and in richer understandings of ontology evaluation at multiple elements. This enrichment is likely to be apparent in the activities and future products of summit participants. Another manifestation of this enrichment will be the summit Communique. The goal of this "hackathons & clinics" activity is to add another manifestation: a formal ontology representing ontology evaluation elements, factors, relationships, processes, etc., as they have emerged from summit discussion. (3PH4)
The scope of this project is staged to increase with available resources or as time permits, beginning with representation of the most important general concepts and their relationships to one another, through representation of specific metrics, tools, ontology characteristics, evaluation processes, and multi-faceted organizations thereof. Scope and prioritization will be requirements-driven, based on use cases. Given the very short duration of the Hackathon, the ambitions of this immediate project have been reigned in a bit. Our deliverable for the primary Hackathon day is now focused on producing a rigorous, readily formalizable conceptual model that covers as much of the target content as is feasible, considered with an eye toward many possible uses and informed by the summit discussions. Our formalized deliverable is moved to the second, optional extension day, and prioritizes support for the Ontology Summit PSMW (see HC-04). (3PH5)
see: [ Project document ] (3PH6)
Collaborators Sought (3PH7)
- Formal and informal modelers to participate in the requirements and content gathering and conceptual modeling to take place on the primary hackathon day (3PH8)
- Formal ontologists willing and able to participate in the extension activity of formalizing the resulting conceptual model. (3PH9)
Activities Scheduled (3PHA)
Primary Hackathon Day: Saturday, 2013-03-30 (3PHB)
Activities: (3PHC)
- Gathering Requirements (whole team, extracting this content into single, shared document) (3PHD)
- Technical requirements for use in PSMW, to support organization, presentation, and reuse of OntologySummit2013 materials and content (i.e., for use by HC-04 team). (3PHE)
- Coverage requirements from various materials presented during the summit, especially those that identify: (3PHF)
- Developing Conceptual Model (whole team, collaborative) (3PHO)
deliverable: (3PHR)
- A rigorous but informal conceptual model of significant aspects of ontology evaluation, as discussed and developed during the summit. Though informal, this model shall be of sufficient clarity, quality, and explicitness to support effective and accurate formalization by all or some of the team. (3PHS)
Optional Extension day: Sunday, 2013-03-31 (3PHT)
Activities (3PHU)
- Formalizing the conceptual model developed on Saturday (3PHV)
- At minimum, formalizing this model in such a way to meet requirements for PSMW use. (3PHW)
- Possibly also formalizing in an ontology language suitable for use by other tools (ontology development environments, evaluation tools, and/or repositories). (3PHX)