OntologySummit2013 Software Environments for Evaluating Ontologies CommunityInput

= OntologySummit2013: (Track-D) "Software Environments for Evaluating Ontologies" Community Input =

Track Co-champions: MichaelDenny, KenBaclawski & PeterYim

Mission Statement:
Through this track, we aim to coordinate the following:


 * provide a venue to bring together individuals and communities who can help define and advance the state-of-the-art in software and systems for evaluating ontologies
 * the collection and enumeration of software environments and tools for evaluating ontologies (with emphasis on those that are open efforts and those that are publicly available)
 * investigations and development work (software prototyping and implementation) focused on the ontology evaluation theme, leading to interim presentations at the symposium, and possibly continued after this Ontology Summit ... (this bullet, which was on our original mission statement is now handled by the Hackathon-Clinics Activities champions - see: OntologySummit2013_Hackathon_Clinics)

see also: OntologySummit2013_Software_Environments_For_Evaluating_Ontologies_Synthesis


 * and the Track-D intro slides from the OntologySummit2013 Launch Event

Enter your input below ... (please identify yourself and date your entry)



OntologySummit2013 Hackathon-Clinic Contributor confcall (n.05) - Fri 2013.03.19

 * Date / Start time: Tuesday 2013.03.19 - 9:00am PDT / 12:00pm EDT / 1:00pm ART / 5:00pm CET / 16:00 GMT/UTC (worldclock)
 * Duration: ~1.5 Hour


 * Dial-in:
 * Phone (US): +1 (206) 402-0100 ... PIN: 141184#, or
 * ... [ backup nbr: (415) 671-4335 ]
 * Skype: joinconference ... PIN: 141184#


 * In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130319


 * Expecting: all leads of submitted hackathon-clinics projects; all independent contributors who have signed up
 * (optional) all OntologySummit2013 organizing committee members, invitees, and all who are interested or considering to participate ... this meeting is open to all (as observers).


 * Attended: MikeDean (co-chair), KenBaclawski (co-chair), PeterYim (scribe), AliHashemi, AmandaVizedom, AnatolyLevenchuk, AstridDuqueRamos, JoelBender, KenBaclawski, MarcelaVegetti, MariCarmenSuarezFigueroa, MariaPoveda, MichaelGruninger, MikeDean, OliverKutz, TillMossakowski, YuriyMilov
 * Observers: BrandNiemann,
 * Regrets: SamirTartir, MatthewWest,

Agenda Idea:

 * collaboratively align and tweak the projects and the teams, so we pare the number down to a few very interesting projects to work on, during the (community picked) Hackathon-Clinics weekends.
 * picking the dates of the Hackathon-Clinics weekend(s) and scheduling projects to those dates
 * prepare for the Thu 2013.03.28 - session-11 - Getting the "hackathon," "clinics" and related activities going virtual session
 * discussing next steps on rolling out the OntologySummit2013 Hackathon-Clinics;

Ref.


 * OntologySummit2013_Hackathon_Clinics
 * the 2013.03.15 meeting announcement

Agenda & Proceedings:

 * audio recording of the session {{
 * edited chat-transcript of this session

1. Roll call, review and adopt agenda.

2. Collaboratively align and tweak the projects and the teams, so we pare the number down to a few very interesting projects to work on, during the (community picked) Hackathon-Clinics weekends.


 * Consolidation consensus - ref. Hackathon_Clinics page at: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Hackathon_Clinics#nid3OAS
 * H1+H2+A1 -> A1
 * H3 and O1 will not be featured this time, and will be pursued outside of the H-C activities
 * H5 -> A3
 * O3+O4 -> O3
 * A2 -> H8
 * H2 & H7 will be featured if there is enough programing support for them (other than the proposers)
 * therefore the selected project (and point-of-contact) are as follows:
 * H4. Ontohub-OOR-OOPS!-OQuaRE (TillMossakowski)
 * H6. OSummit-content-hack (KenBaclawski)
 * H8. Ontology-of-Ontology-Evaluation (AmandaVizedom)
 * O2. 15926-ref-data-validation (VictorAgroskin)
 * O3. FIBO-Clinic (MikeBennett)
 * A1. GOEF-I-Choose (JoanneLuciano)
 * A3. BACnet Clinic (JoelBender)
 * The project point person(s) - TillMossakowski(H4), KenBaclawski(H6), AmandaVizedom(H8), VictorAgroskin(O2), MikeBennett(O3), JoanneLuciano(A1) and JoelBender(A3) are kindly requested to update their project documents and send them in within this week (by Friday 3/22 if you please) ... please send to [ontology-summit] list, or direct to wiki (then advise the list) and also mail the co-champions a pdf version of the project document for archival purposes.

3. Picking the dates of the Hackathon-Clinics weekend(s) and scheduling projects to those dates


 * Candidate-1: Sat(-Sun) 2013.03.30~31
 * Candidate-2: Sat(-Sun) 2013.04.06~07
 * Candidate-3: Sat(-Sun) 2013.04.13~14


 * we will assume that each project will take up one day (the Saturday will be the main event day, the Sunday will be an optional extension day, if the team wants to spend more time finishing up.)

4. Prepare for the Thu 2013.03.28 - session-11 - Getting the "hackathon," "clinics" and related activities going virtual session


 * Session plan for the Mar-28 session-11 - developing session page on: http://ontolog.cim3.net/cgi-bin/wiki.pl?ConferenceCall_2013_03_28
 * for the 3/28 session - after overview by Mike-Ken-Peter, the 7 project point persons will each do a short presentation (~8 min, 3~5 slides) on their projects
 * [action] project point-persons, please be prepared to present on 3/28, slides due 3/26

5. Discussing next steps on rolling out the OntologySummit2013 Hackathon-Clinics;


 * PeterYim will harmonize the schedule input received and post a proposed hackathon-clinics calendar for everyone on the [ontology-summit] list to review and adopt

6. Any other business

7. Follow-up, next meeting, adjournment.


 * let's discuss over the [ontology-summit] (for general and proposal-related issues) and [ontolog-dev] (for low level hackathon details) mailing lists

-- session ended: 10:32 am PDT --

OntologySummit2013 Hackathon-Clinic Proposal confcall (n.04) - Fri 2013.03.05

 * Date / Start time: Tuesday 2013.03.05 - 7:00am PST / 10:00 am EST / 12:00pm ART / 4:00pm CET / 15:00 GMT/UTC (worldclock)
 * Duration: ~1.25 Hour


 * Dial-in:
 * Phone (US): +1 (206) 402-0100 ... PIN: 141184#, or
 * ... [ backup nbr: (415) 671-4335 ]
 * Skype: joinconference ... PIN: 141184#


 * In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130305


 * Expecting: MikeDean (co-chair), PeterYim (co-chair), KenBaclawski, and all who plan to participate in the OntologySummit2013 "Hackathon" and "Clinics" activities ... (anyone else from the summit organizing team interested and can commit time and effort into this are welcome.)


 * Attended:
 * Regrets:

Ref. Call for Proposals to the the "hackathon" and "clinics" activities - http://ontolog.cim3.net/forum/ontology-summit/2013-02/msg00056.html

Agenda Idea:

 * Make explicit that proposals may include slots for which they want/need additional help (what expertise). Also, there should be a call for, and way for, willing contributors who are not affiliated with one of these projects to register themselves and their skills, for proposers to see (and to generate additional energy/excitement). Having these separate, explicitly, may help with proposal speed / number (suggested by AmandaVizedom)
 * encouraging collaboration and partnering in putting together a proposal
 * any remaining issues, Q&A ref. the making of a "hackathon" or "clinic" proposal
 * re-assess planned timeline and milestones

Ref. 2013.02.21 presentation on the "Hackathon-Clinics" Approach, and the 2013.03.01 clarification

Agenda & Proceedings:

 * audio recording of the session {{
 * edited chat-transcript of this session

1. Roll call, review and adopt agenda.

2. Taking inventory on candidate projects, and Q&A ...


 * Any question on what are projects under: "Hackathon," "Ontology Clinic-A," "Ontology-Clinic-B" & "Application Clinic" ... questions on the proposal writing?
 * ref. slides#11


 * ref. slides#5, 7 & 9 - what is still ON, what is OFF, and what other projects are on deck?
 * ref. OntologySummit2013_Hackathon_Clinics
 * * see status in chat-transcript

3. Possible coordination to make as many of these projects into reality as we can


 * what gaps are there in people's proposals
 * who (indepedent participants) is offering to join - http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013_Hackathon_Clinics#nid3O1R
 * what other resources are available

4. Reviewing the Calendar again - slides#13:


 * Announcement of the call for proposals: Thu 2013.02.21
 * Deadline for proposal submission: Thu 2013.03.08 (2 weeks to prepare proposal)
 * Alignment of projects and teams: 2013.03.09~03.19 (10 days to tweak proposals/projects)
 * Announcement of selected projects: Thu 2013.03.21
 * Hackathon-Clinics project plan debut: session-11 - Thu 2013.03.28
 * Staging of projects: Fri 2013.03.22 to hackathon-clinics weekend (see below; 1 week+)
 * Hackathon-Clinics Weekends:
 * Candidate-1: Fri-Sat 2013.03.30~31
 * Candidate-2: Fri-Sat 2013.04.06~07
 * Candidate-3: Fri-Sat 2013.04.13~14
 * preparation of writeup/presentation/demo - 2013.04.15~29 (2 weeks+)
 * writeup/presentation/demo material due - 2013.04.30 (2 days before event)
 * Presentation / Demo: Thu 2013.05.02 (Symposium Day-1)
 * (?)Award Ceremony: Fri 2013.05.03 (Symposium Day-2)


 * do we want/need to extend the 2013.03.08 (this Thursday) proposal submission deadline?
 * PeterYim: looks like we don't need to ... however, Again, proposal deadline is 2013.03.08 (this Thursday) ... anyone who needs an extra day or two for this, should write  offline about it.

5. Any other business


 * YuriyMilov: why limit the hackathon to 1 or 2 days ... why not 4 weeks?
 * Answer: [ppy] the constraint is in our ability to sustain an open distributed collaboration workspace for intensive work for a long time ... we should recognize the project partner can (and would) be working independent of those 1 or 2 days; just treat those 1 or 2 days as the "community collaboration" days.

6. Action items


 * see details in chat-transcript

7. Follow-up, next meeting, adjournment


 * let's discuss over the [ontology-summit] (for general and proposal-related issues) and [ontolog-dev] (for low level hackathon details) mailing lists

-- session ended: 8:30 am PST --

OntologySummit2013 Survey and Website sub-team confcall (n.03) - Fri 2013.02.22

 * Date / Start time: Friday 2013.02.22 - 6:00am PST / 9:00 am EST / 11:00am ART / 3:00pm CET / 14:00 GMT/UTC
 * Duration: ~1.0 Hours (for survey); maybe another 30 minutes on website planning


 * Dial-in:
 * Phone (US): +1 (206) 402-0100 ... PIN: 141184#, or
 * ... [ backup nbr: (415) 671-4335 ]
 * Skype: joinconference ... PIN: 141184#


 * In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130222


 * Expecting: MikeDenny (chair), KenBaclawski, SimonSpero, AmandaVizedom, MarcelaVegetti, AliHashemi, PeterYim, ... (anyone else from the summit organizing team interested and can commit time and effort into this are welcome.)


 * Attended: MikeDenny (chair), KenBaclawski, SimonSpero, AmandaVizedom, MarcelaVegetti, AliHashemi, PeterYim (scribe)
 * Regrets:

Ref. 2013.02.15 organizing committee discussion: http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2013/GettingOrganized#nid3M2R

Agenda & Proceedings:

 * audio recording of the session {{
 * chat-transcript of this session

1. Roll call, review and adopt agenda.


 * attendees - see above
 * we ran into problems with the chat-room (soaphub server seems to be down), please go to the google-doc here

2. 2013-Survey design, implementation and deployment discussion - we want to come away with a plan for: (ref.)


 * 1) finalizing the list of software capabilities;
 * MikeDenny: feedback collected, looks like only minor changes needed. MikeDenny will get a revised list out by cob Thu 2013.02.28 [action: MikeDenny]
 * MikeDenny: I will be traveling for 10 days starting Fri 2013.03.01 (will miss the organizing committee meeting on Mar-1 too)
 * 2) reviewing prototypes from candidate software providers;
 * 3) publishing the survey in a convenient form ... reviewing:
 * prototype on LimeSurvey from SimonSpero - Simon: (for now) see: alt-A (scrn-shot) & alt-B (scrn-shot)
 * prototype on OntologPSMW from KenBaclawski ... Ken: give it a try ...
 * http://ontolog-02.cim3.net/wiki/OntologySummit2013_Survey_Prototype_Untabbed
 * http://ontolog-02.cim3.net/wiki/OntologySummit2013_Survey_Prototype_Tabbed
 * we are missing the the header tabs extension at the ontolog-02 wiki (for now), so all of the questions show up as separate sections on a single page rather than tabs ... this is what it should look like.
 * note that one will have to log in, to contribute to the survey (the login anyone is using at the OntologWiki now should also work on the OntologPSMW)
 * [decision] MikeDenny & ALL: we will do the survey on the OntologPSMW
 * MikeDenny with work with KenBaclawski to develop the survey form - will use the [ontolog-dev] mailing list for the communications (so we can document the process and details for future reference.)
 * 4) collecting and publishing the survey results.
 * [action - KenBaclawski] will have the initial survey ready by Mon 2013.02.25 ... Mike will provide comments to Ken (in fact, MikeDenny can even edit the survey himself, if he wants to; afterall it is on a wiki).
 * [action - MikeDenny, KenBaclawski] will aim at having the survey instrument done (all questions and content finalized) by - Thu 2013.02.28
 * [action - MikeDenny, et al.] will also discuss how to circulate and promote the survey over [ontology-summit-org] list
 * Peter will add Ken to the [ontology-summit-org] list
 * [action - MikeDenny] we will aim to release on Wed 2013.03.13
 * [action - MikeDenny] we will aim to release on Wed 2013.03.13

3. Website design, implementation and deployment discussion


 * Marcela: see my SMW prototype (scrn-shot)
 * ... and the ontology I am using for this prototype
 * Peter: we will develop the OntologySummit2013 PSMW site on the wiki instance at - http://ontolog-02.cim3.net/wiki/
 * our target is to create a "prettier" website (as a start: like what we had last year) - ref. http://ontolog.cim3.net/OntologySummit/2012/
 * we need to work on the look-and-feel too - need some UI, css and skin development skills
 * [action] let's continue the discussion on the [ontolog-dev] list

4. Any other business


 * exposing/publishing 2012-survey work ... [discussion deferred]

5. Action items


 * see above

6. Follow-up, next meeting, adjournment


 * no real-time meeting planned. We'll do it asynchronously on the mailing lists (as discussed above.)
 * no real-time meeting planned. We'll do it asynchronously on the mailing lists (as discussed above.)

-- session ended: 7:57am PST --

OOR OntologySummit2013 Hackathon-Clinic Team Meeting (n.02) - Tue 2013.02.05

 * Date / Start time: Tuesday 2013.02.05 - 7:30am PST / 10:30am EST / 4:30pm CET / 15:30 GMT/UTC
 * Duration: 1.5 Hours


 * Attendees: PeterYim (chair), KenBaclawski, MariaPoveda, MikeDean, MikeDenny, OliverKutz, TillMossakowski, YuriyMilov

Full details at: OOR/ConferenceCall_2013_02_05


 * audio recording of the session {{
 * chat-transcript of this session

Software for Ontology Evaluation: Exploratory Meeting - Fri 2013.01.25
Conference call details:


 * Date / Start time: Friday 2013.01.25 - starting 8:00am PST / 11:00am EST / 5:00pm CET / 4:00pm GMT/UTC
 * ref. world clock
 * Expected Duration: ~1.5 Hrs.
 * Dial-in:
 * Phone (US): +1 (206) 402-0100 ... PIN: 141184#, or
 * ... [ backup nbr: (415) 671-4335 ]
 * Skype: joinconference ... PIN: 141184#
 * In-session chat-space: http://webconf.soaphub.org/conf/room/summit_20130125


 * Invited: KenBaclawski, DavidLeal, VictorAgroskin, TillMossakowski, MichaelGruninger, MikeDean, MichaelDenny, PeterYim, ... also, LeoObrst, SteveRay, KingsleyIdehen, SimonSpero, JoanneLuciano, YuriyMilov, HaroldSolbrig, TaniaTudorache, TrishWhetzel, JieBao,
 * this is an open meeting, besides the those invited (above), everyone else who are interested in supporting the track-D or the potential "hackathon" work are welcome; those on the [ontology-summit-org] list; and other invitees of the organizing committee.


 * Attended: PeterYim (chair), DavidLeal, KenBaclawski, MikeDenny, MikeBennett, TillMossakowski, YuriyMilov
 * Regrets: TaniaTudorache, PaulAlexander, MikeDean, ToddSchneider, VictorAgroskin, SteveRay (traveling), LeoObrst (will try to join), JoanneLuciano (will try to join),


 * Add your Agenda Ideas and anything you want discussed at this meeting below:

Agenda & Proceedings:
{{

[ chat transcript ]


 * Opening, roll call, self-intros, adopt agenda


 * What are we trying to achieve?
 * quick review of the the Track-D intro slides from the OntologySummit2013 Launch Event
 * Noting: already on the Master Calendar -
 * Thu 2013.02.14 - session-05 - Track-D
 * Thu 2013.02.21 - session-06 - Synthesis-I; proposed Communique Outline; exploring a "hackathon"
 * Thu 2013.03.21 - session-10 - Track-D
 * Thu 2013.03.28 - session-11 - preparing for a "hackathon" and/or related activities
 * Thu 2013.04.25 - session-15 - pre-symposium prep
 * Thu & Fri 2013.05.02 & 03 - Symposium (F2F)


 * aligning what we mean by the "hackathon"
 * what: need to define the "challenge" between now and March
 * how: distributed network of power hack-teams (who would probably be co-located)
 * when: weekends between 2013.03.28 and 2013.04.25 ... maybe earlier (to avoid conflict with students' final exams)


 * Getting organized
 * (i) (A) Research, Survey, Enumerate "what's out there," and (B) showcase exemplary software environments and tools for evaluating ontologies
 * who's on board: MichaelDenny (will lead 'Research, Survey, Enumerate "what's out there"' effort), MikeBennett, ...
 * candidate deliverables: ... (deferring to discussion on mailing list) ... suggest starting with each member (or team-pair) propose their own deliverable(s) and then discuss
 * (ii) User communities that have real needs to evaluate ontologies, to provide us the use cases, upon which we can ground our work
 * who's on board: (Manufacturing / Process Industry) DavidLeal, (Finance) MikeBennett, (Earth Science) PeterFox (added: JL/2013.01.28) ... RDA?? Biomedical Informatics??
 * candidate deliverables: ... (deferring to discussion on mailing list) ... suggest starting with each member (or team-pair) propose their own deliverable(s) and then discuss
 * (iii) Communities/teams of Ontology Software developers and tool-makers, who will join us in this track's activities, especially in terms of prototyping and implementations that could help advance the state-of-the-art in software and systems for ontology evaluation
 * who's on board: TillMossakowski, KenBaclawski, YuriyMilov, ... VictorAgroskin, MikeDean
 * candidate deliverables: ... (deferring to discussion on mailing list) ... suggest starting with each member (or team-pair) propose their own deliverable(s) and then discuss


 * Any other business
 * YuriyMilov suggested, and there was consensus among those at the meeting, that, for the hackathon work, all hack-teams will put their work on the Eclipse development environment.


 * Action items


 * Next meeting, wrap-up
 * [consensus] (for now) we will not make further attempts to confer synchronously (it's too difficult) and will defer to asynchronous transactions
 * we will communicate all other outstanding issues via this wiki page, and via discussions on the mailing list(s) -
 * "[ontology-summit] " for teams (i) & (ii) work
 * "[ontolog-dev] " for team (iii) work ... PPY: I will subscribe everyone on this team to this list

session adjourned: 9:10 am PST -- notes taken by: PeterYim / 2013.01.25-9.14am PST All participants, please review and edit to enhance accuracy and granularity of the documented proceedings.