ADMIRAL planning
From ImageWeb
Contents |
ADMIRAL Project Planning
ADMIRAL Project plan outline for October 2009 to March 2011
- JISC project proposal: http://imageweb.zoo.ox.ac.uk/pub/2009/admiral/ADMIRAL_Project_Case_for_Support.pdf
- Project management notes / agile ecosystem: ADMIRAL agile ecosystem and project procedures
Phase 2
Phase 2 revised plan - ADMIRAL_planning_phase_2
(Scroll down for Phase 1 sprint plans and summaries.)
Sprints
The project will be run along agile lines, as a series of "sprint"s or iterations, which will aim to achieve the progress outlined in the outline plan. Each sprint will be planned in greater detail when it starts, adjusting the goals to take account of progress made and user feedback to date.
My goal is 2-week/10-working-day sprints, but the early sprints are longer as the project gets under way, or where time is shared with other activities.
| Sprint | Dates | Effort | Planning meeting | Review meeting | Goals achieved |
|---|---|---|---|---|---|
| Sprint 16 | 4 Jan - 21 Jan | 14 days | sprint 16 planning | sprint 16 review |
Improved deployment scrips to facilitate updates |
| Sprint 17 | 26 Jan - 11 Feb | 13 days | sprint 17 planning | sprint 17 review | (see next) |
| Sprint 17+ | 12 Feb - 1 Mar | 12 days | (No formal plan) | sprint 17 review |
Two new ADMIRAL deployments; Silk group storage upgraded |
Quick reviews for final stages of project
For the final stages of the project (Mar-Jun) we are focusing on dealing with items recorded in the issue list (http://code.google.com/p/admiral-jiscmrd/issues/list), paying attention mainly to those marked as high or medium priority. Day-to-day planning is recorded in an internal group calendar, but we aim to post weekly "quick reviews" here to provide visibility of our activities.
- 20110307 Quick Review
- 20110316 Quick Review
- 20110322 Quick Review
- 20110331 Quick Review
- 20110406 Quick Review
- 20110513 Quick Review
- 20110520 Quick Review
- 20110603 Quick Review
Phase 1
Sprints
The project will be run along agile lines, as a series of "sprint"s or iterations, which will aim to achieve the progress outlined in the outline plan. Each sprint will be planned in greater detail when it starts, adjusting the goals to take account of progress made and user feedback to date.
My goal is 2-week/10-working-day sprints, but the early sprints are longer as the project gets under way, or where time is shared with other activities.
| Sprint | Dates | Effort | Plan | Planning meeting | Review meeting | Goals achieved |
|---|---|---|---|---|---|---|
| Setup | Project plan to JISC | |||||
| Sprint 1 | 01 Dec - 31 Dec | 13 days | sprint 1 plan | Project wiki, blog, management framework; RA position offered; data audit questionnaire prepared | ||
| Sprint 2 | 01 Jan - 29 Jan | 19+10 days | sprint 2 plan | sprint 2 review | Met with DCC and other Oxford projects; New RA employed and contributing; LSDS base system selected | |
| Sprint 3 | 01 Feb - 15 Feb | 10+11 days | sprint 3 plan | sprint 3 planning | sprint 3 review | Initial system build script; permanent hosting investigations |
| Sprint 4 | 16 Feb - 04 Mar | 13 days | sprint 4 plan | sprint 4 planning | sprint 4 review | Initial user requirements; LDAP setup; Samba setup; WebDAV setup; Automated LSDS build, test and monitoring; Specify and order server; FAIL: Kerberos authentication |
| Sprint 5 | 08 Mar - 31 Mar | 18 days | sprint 5 plan | sprint 5 planning | sprint 5 review | Virtual hosting environment set up; Silk Group file sharing mostly complete; |
| Sprint 6 | 12-Apr - 30-Apr | 15 days | sprint 6 plan | sprint 6 planning | sprint 6 review |
Silk Group file sharing ready for use; |
| Sprint 7 | 10 May - 28 May | 15 days | sprint 7 plan | sprint 7 planning | sprint 7 review |
Project and steering group meetings; |
| Sprint 8 | 02 Jun - 30 Jun | 21 days | sprint 8 plan | sprint 8 planning | sprint 8 review |
Project partner and OULS meetings; |
| Sprint 9 | 7 Jul - 16 Jul | 8 days | sprint 9 plan | sprint 9 planning | sprint 9 review |
Project partner meeting; |
| Sprint 10 | 19 Jul - 30 Jul | 8 days | sprint 10 plan | sprint 10 planning | sprint 10 review |
Completed JRON/RDF conversion library and test suite |
| 2 Aug - 23 Aug | 16 days | Vacation and non-ADMIRAL project work | ||||
| Sprint 11 | 24 Jul - 7 Sep | 9 days | sprint 11 plan | sprint 11 planning | sprint 11 review |
Familiarizing/training new employee with ADMIRAL project, technologies and methods |
| Sprint 12 | 6 Sep - 24 Sep | 15 days | (offline) | sprint 12 planning | sprint 12 review | (Sprint abandoned part way through) An initial implementation of a Databank dataset overview display was implemented. |
| Sprint 13 | 5 Oct - 20 Oct | 12 days | (offline) | sprint 13 planning | sprint 13 review |
Repository content dataset selection and display completed |
| Sprint 14 | 26 Oct - 12 Nov | 14 days | (offline) | sprint 14 planning | sprint 14 review |
Completed revisions to LSDS test suite for private file areas and other changes |
| Sprint 15 | 15 Nov - 10 Dec | 20 days | (offline) | sprint 15 planning | sprint 15 review | ... |
Reporting checklist
(Adapted from JISCRI reporting framework)
Project announcements blog: http://admiral-announce.blogspot.com/
Aggregated #jiscmrd blog entries by @simonhodson99: http://www.netvibes.com/jiscmrd#RDMI_Projects
| Name | Description | Tags | Date |
|---|---|---|---|
| Project plan | Project plan sent to JISC http://imageweb.zoo.ox.ac.uk/pub/2009/admiral/20091021-ADMIRAL-Project-Plan-NoBudget.pdf | 30Oct2009 | |
| User participation | What is the core user case(s) you think of when developing the app; how has this story changed as you have engaged with the end user | userCase, endUser, progressPosts, JISCMRD, JISC, ADMIRAL | |
| Day-to-day work | what software tools or productivity methods do you use and how do you use them? How do they make you more productive and why do you see value in using them? | methodology, implementation, productivity, progressPosts, JISCMRD, JISC, ADMIRAL | |
| Technical standards | what technologies, frameworks, standards or anything else that makes your life easier (or harder) in your work. For example: what programming language (or framework, IDE, pattern, etc) do you use and why do you love it. | techStandards, technicalDevelopment, progressPosts, JISCMRD, JISC, ADMIRAL | |
| Value Add | What was the more important thing you discovered that brought value to your project, e.g. what was the "wow" moment that made you change your perspective on a specific technology or process. | valueAdd, disruptiveInnovation, progressPosts, JISCMRD, JISC, ADMIRAL | |
| Small WIN(s) & FAIL(s) | announce small wins for the project, e.g. when you finish a coding sprint or when a user has a 'wow your software is cool' moment. | WIN, progressPosts, JISCMRD, JISC, ADMIRAL | |
| or | FAIL, progressPosts, JISCMRD, JISC, ADMIRAL | ||
| or | progressPosts, JISCMRD, JISC, ADMIRAL | ||
| Sprint plans | New and revised plans generated periodically, responding to user requirements and actual prior progress. Also, meta-issues about project conduct and reporting. | Planning , progressPosts, JISCMRD, JISC, ADMIRAL | |
| Retrospective | Review of progress, lack of progress and lessons learned from | retrospection, progressPosts, JISCMRD, JISC, ADMIRAL | |
| -- | -- | --, JISCMRD, JISC, ADMIRAL | |
| -- | -- | --, JISCMRD, JISC, ADMIRAL |
Outline plan from proposal
| WP | Activity |
|---|---|
| WP0 | Project management |
| WP1 | Data storage/LSDS |
| WP2 | Annotation |
| WP3 | Dataset and metadata packaging |
| WP4 | Repository submission of selected datasets |
| WP5 | Links to external web services |
| WP6 | Formalization of annotations |
| WP7 | DOIs for datasets |
| WP8 | Licences for published datasets |
| WP9 | Evaluation |
First phase
| Date | WP | Activity | Milestone and/or deliverable |
|---|---|---|---|
| Oct-2009 | WP0 | Project plan | Project plan submitted to JISC |
| WP0 | Recruitment | Position advertised | |
| WP9 | Data audits | ||
| Nov-2009 | WP0 | Recruitment | Short listing |
| WP9 | Data audits | Data audits for each research partners | |
| Dec-2009 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP0 | Recruitment | Position offered | |
| WP0 | Set up project infrastructure (5d) | Project version management, wiki, blog, discussion list in place. Project summary description and initial plans published. | |
| WP1 | Survey networked/web file system options. Survey authentication mechanisms and single-sign-on integration of networked file system. Discussion with colleagues at Cambridge. (10d) | Selected platform and software for LSDS | |
| Jan-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP0 | Induction and training new recruit | New recruit in place | |
| WP0 | Advisory board meeting | Record of advisory board meeting | |
| WP1 | Deploy and configure file system host (5d) Deploy and configure shared data file system (10d) | Deployed, access-controlled web-accessible file system. | |
| WP2 | Annotation requirements gathering (use data audits as starting point). Focus on annotations that can support archiving and retrieval (see WP3) (10d) | Identified initial data set annotations to implement, and potential vocabularies | |
| Feb-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP1 | User configuration and training (5d) | Deployed, access-controlled web-accessible file system – ready for use by researchers. | |
| WP2 | Implement Shuffl access to web file system (plug-in) (10d) | Shuffl can use LSDS for saving workspaces and annotations. | |
| WP2 | Pair-programmed implementation of Shuffl plug-in for annotating user data, and demonstrate these to research users as soon as possible (10d) | Initial implementation of at least 1 Shuffl plug-in for data annotation, and user feedback | |
| Mar-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP3 | Survey and select format and vocabularies for bundling datasets with annotations (considering what can be accepted by OULS). (10d) | Identified data format(s) and administrative vocabularies to be used for bundling datasets with annotations | |
| WP3 | Check metadata coverage of selected data format/vocabularies with research users – articulate retrieval use-cases (10d). | Identified domain vocabularies to be used for bundling datasets with annotations | |
| WP4 | Discuss submission requirements with research partners, OULS and CLARION teams (5d). | Agreed publication embargo policies with research users, on a case-by-case basis. | |
| Apr-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP3 | Create packaging tools to create bundles for submission to OULS databank. Test use of packaging tools applied to real data (10d). | Initial implementation of tooling to create archival submission packages from datasets, Shuffl annotations. | |
| WP4 | Initial implementation of submission tools – e.g. SWORD protocol client (10d). | Initial submission tools. | |
| May-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP3 | Refine submission package tooling based on user feedback. Work with users to create archive submission packages for selected datasets. (10d) | Data packages ready for repository submission | |
| WP4 | Review submission tools with partners and users, including selection of embargo policies (5d). | ||
| WP4 | Refine submission tools (5d). | Submission tools ready for use. | |
| WP4 | Configure Databank to implement embargo policies (OULS – 10d) | ||
| Jun-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP3 | Review and publish documentation and training materials for packaging tools (5d) | Stable, published user documentation | |
| WP4 | Perform and debug initial submissions from shared file system (10d) | Initial submissions from LSDS to data repository. | |
| WP4 | Review and publish documentation and training materials for submission tools (5d) | Stable, published user documentation | |
Second phase
Note: this section is erroneous, and does not match the project plan submitted to JISC. It should, in any case, be re-planned when approach this phase.
| Date | WP | Activity | Milestone and/or deliverable |
|---|---|---|---|
| Q2-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP0 | Advisory board meeting | Record of advisory board meeting | |
| WP4 | Ongoing management of data repository for the duration of the project | ||
| WP5 | Survey and evaluate external services that can be used to enhance research data annotations. Discuss requirements and options with researchers users (20d) | Selected 4 external services for data enhancement. | |
| WP5 | Initial implementation and user demonstration of first 1 or 2 annotation enhancement services (20d) | Initial implementation and demonstration of at least one enhancement service as Shuffl plug-in. | |
| WP5 | Initial implementation and user demonstration of remaining annotation enhancement services (15d) | Initial implementation and demonstration of all 4 enhancement services. | |
| WP5 | Refinement of annotation services based on user feedback (15d) | Usable implementation of enhancement services. | |
| Q3-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP6 | Ontology survey and selection (taking account of stored research datasets) (10d) | Identified target ontologies | |
| WP6 | Tooling for ontology-led card population (30d) | Shuffl data entry cards that perform input data checking based on a given ontology-based description. | |
| WP6 | Entry of selected new data with ontology linkage. (15d) | Formal annotations for data created by means of ontology-assisted data entry cards (e.g. autocompletion for controlled vocabulary terms). | |
| WP6 | Metadata validation support (e.g. global as well as local conformance). (10d) | Tooling to check individual cards and collections for consistency with a given formal structure. | |
| Q4-2010 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP6 | Survey minimum information standards that may be of relevance to our researchers' data (5d) | Identified minimum information standards relevant to reorganizing card data in a more usable structure. | |
| WP6 | Identify ways in which card data can be revised to reflect minimum information or formal ontology structures; describe required transformations (10d) | Identified data fields containing formalizable information, and descriptions of transformations to formal form. | |
| WP6 | Card refactoring tool support (30d) | Initial implementation of mechanisms to perform the identified transformations. | |
| WP6 | Apply refactoring to a trial dataset. This is likely to be a tool-supported manual process. (10d) | Dataset elements expressed using formalized structure and terms. Revised tooling to assist with transformation. | |
| WP6 | Apply refactoring to a second trial dataset. (10d) | Dataset elements expressed using formalized structure and terms. Revised tooling to assist with transformation. | |
| WP7 | Assign DOIs to datasets (5d + OULS 5d) | DOIs used to locate and retrieve datasets | |
| WP8 | Select and apply (attach and serve) machine-readable licences (10d + OULS 2d) | Machine-processable licence retrievable for stored datasets. | |
| Q1-2011 | WP0 | Sprint planning and review | Sprint plans and retrospectives |
| WP0 | Final report | Final report delived to JISC. | |
| WP0 | handover to IT support for continuing operation of LSDS service | Costing plans for new research projects that require use of LSDS facilities. | |
| WP0 | Finalize status of open source and open access materials. | Open source software in good order (clear copyright status, distribution licensing, continued contribution arrangements, etc.). Open access data licences, embargos, etc. all in good order. | |
| All | Work with research partners to identify, specify, implement and refine key additional functions that help to get real value from the system. | Updated software systems and tools. | |
| All | Final documentation, | LSDS and supporting tools available and adequately documented for ongoing use by researchers. | |
| All | Dissemination and demonstration activities; preparation for further work. | Papers, presentations; plans and proposals for further work. | |
| All | Finalize status of open source and open access materials. | Open source software in good order (clear copyright status, distribution licencing, continued contribution arrangements, | |
| WP9 | Final review of researcher data management practices | Comparison of researcher working practices compared with baseline data audit. | |
| WP9 | Draft data management plans based on LSDS, OULS data repository and supporting tools. | Sample data management plans for researchers using LSDS. | |
Effort schedule
A=ADMIRAL
M=MILARQ
v=vacation
d=DevCSI
Graham Klyne:
2009 October November December 05.12.19.26.02.09.16.23.30.07.14.21.28 --.--.--.--.--.--.--.--.--.A-.A-.Av.Av --.--.--.--.--.--.--.--.A-.A-.A-.Av.Av --.--.--.--.--.--.--.--.A-.A-.A-.Av.Av --.--.--.--.--.--.--.--.Av.A-.A-.Av.Av --.--.--.--.--.--.--.--.Av.A-.A-.Av.Av 2010 January February March April May June 04.11.18.25.01.08.15.22.01.08.15.22.29.05.12.19.26.03.10.17.24.31.07.14.21.28 A-.Av.A-.A-.A-.A-.A-.A-.A-.A-.M-.M-.A-.Av.A-.A-.A-.Av.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.M-.M-.A-.Av.A-.A-.M-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.Av.A-.A-.M-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.Av.Av.M-.A-.A-.A-.A-.M-.A-.A-.A-.M-.A-.A- A-.A-.A-.A-.A-.Ad.A-.A-.A-.A-.A-.A-.Mv.Mv.M-.A-.A-.M-.M-.M-.M-.M-.M-.M-.M-.M- July August September October November December 05.12.19.26.02.09.16.23.30.06.13.20.27.04.11.18.25.01.08.15.22.29.06.13.20.27 A-.A-.A-.A-.Av.Av.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.Av.Av.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.Av.Av.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.M-.A-.A-.Av.Mv.A-.A-.A-.M-.A-.A-.A-.M-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A- M-.M-.M-.M-.Mv.Mv.M-.M-.M-.M-.M-.M-.M-.M-.M-.M-.M-.A-.A-.A-.A-.A-.A-.A-.A-.A- 2011 January February March 03.10.17.24.31.07.14.21.28.07.14.21.28 A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A- A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-.A-
