r9 - 07 Feb 2003 - 11:38:00 - TonyLindeYou are here: TWiki >  Astrogrid Web  >  DocStore > OversightPage > OversightCommittee > AgocUpdate

Update to AGOC on Deliverables, Milestones and Risks

submission to AGOC meeting, 30-Jan-2003

This is an update of section 10.7 of the AstroGrid PhaseAReport (1). In that section, we provided an outline set of milestones based on the components and functionality to be delivered every second iteration. The GSC found that this was not sufficient. The GSC also criticised our failure to provide a risk analysis for the project. This document corrects these failures. When accepted by the AGOC, its contents will be incorporated into the Phase A Report and that report issued formally.

As a quick recall, Phase B of the AstroGrid project is scheduled to begin on January 1st 2003 and continue for a period of two years. All new staff will be recruited onto two-year contracts and, since some may not be on board until March/April time, the project will actually continue into 2005 (thus providing support during the period when the future of AstroGrid is likely to be decided). The project will be carried out using the Unified Software Development Process and development of the software components will be conducted in a series of incremental iterations. This process is documented in some detail in the PhaseAReport.

As is known, all of the AstroGrid project documentation is online (2). In line with this we have added a new root document at PhaseBStructure (3). The project work for Phase B has been broken down into:

  • Research Activities
  • Component Development

and each of these sections has its own tasks and, within those tasks, deliverables and milestones. This document will present a summary of those more detailed pages (many of which are not yet complete and some of which will only be completed in the second or third iteration).

Component Development: Milestones

It is relatively simple to define milestones for an iterative software development project. A milestone occurs at the end of each iteration. In the case of AstroGrid, we have initially decided upon three-month iterations, so our milestones will occur as in the following table. For each milestone, we have listed the components most changed in that iteration and the functionality to be delivered.

Itn Date Component Functionality
01 31-Mar-2003 Portal Portlet template & API
      General portlets: Login & News
    Workflow Portlet: Interactive registry query
      Activity logging
    Registry Schema developed and published
      Can store metadata on Data Centres & Datasets
      Returns results of simple query (structure tbd)
    AstroMQ Pass-through stub
02 30-Jun-2003 Community Portlet: Community management
    AstroPass Design document
    Workflow Portlet: Interactive data query
      Make results available for download
    Registry Portlet: Registry management
      Can store metadata on communities & people
    Data Centre Allow access to dataset
    Dataset Access Execute query and return results
03 30-Sep-2003 Portal Portlet: AstroPass login
    AstroPass Username/password login
      Store user metadata: contact details, preferences
      User determines level of details released to each site
    Job Control Design document
    Registry Portlet: add management features
    MySpace Store query results (single site)
      Design document for multi-site storage
    Data Centre Create web service for data routing
    AstroMQ Implement
04 31-Dec-2003 Workflow Portlet: Job creation (accessing single dataset) & submission
    Job Control Portlet: Job monitoring
    Registry Store data access policies
      Portlet: add policy management
    MySpace Portlet: Multisite Explorer
      Upload own data
    Data Centre Expand interface to implement data policy & permissioning
    Astronomical Tools Package simple (non UI) tool
05 31-Mar-2004 Community Interoperability: two communities exchange data
    Workflow Portlet: add: Recall previous job & Multi-site job submission
    Job control Portlet: add: multisite control
    MySpace Allow database/table storage (incl conversion)
    Data Centre Validate query credentials before execution
      Add warehousing facilities (database & analysis functions)
    Dataset Access Query includes creation of warehouse for in-depth analysis
    Data Federation Federate query results
    Visualisation Generate jpg/gif for online viewing
06 30-Jun-2004 Portal User-defined portlet layout
    AstroPass User uploads certificate
      User certificate used in place of AstroPass proxy
    Job Control Interoperability: include function outside of AstroGrid
      Allow interjob pipeline for data transfer
    Registry Interop protocols implemented: search across multiple registries
    Data Centre Validation of query using user certificate
    Dataset Access Upload own algorithm and include in job
    Astronomical Tools Data converters
07 30-Sep-2004 Portal Portlet: API allows custom UI
    Workflow Automatically insert data converters
    Visualisation Interface with desktop tools
    Astronomical Tools Package UI tools for portlet use

We imagine that Iteration 08 (to complete by 31-Dec-2004) will be mainly concerned with implementing AstroGrid in at least two data centres and fixing any issues that this raises.

Research Activities

Any research activity undertaken during AstroGrid Phase B will be required to deliver specific benefits to the development programme. We have highlighted five such activities:

Research Activity Planned Start Planned End Deliverable Date
Data Warehouse 01-Apr-2003 30-Sep-2003 Research Plan 30-Apr-2003
      Prototype warehouse 31-Jul-2003
      Demo site 31-Aug-2003
      Design document 30-Sep-2003
Federate Query Results 01-Jul-2003 31-Dec-2003 Research Plan 31-Jul-2003
      Demo functionality 30-Nov-2003
      Design document 31-Dec-2003
Data Mining Tools 01-Oct-2003 31-Mar-2004 Analysis of existing tools 31-Oct-2003
      Research Plan 31-Oct-2003
      Prototype toolset V1 14-Nov-2003
      Prototype toolset V2 28-Feb-2004
      Design/implementation document 31-Mar-2004
Job Optimisation 01-Jan-2004 30-Jun-2004 Research Plan 31-Jan-2004
      Demo functionality 31-May-2004
      Design document 30-Jun-2004
Query Optimisation 01-Apr-2004 30-Sep-2004 Research Plan 30-Apr-2004
      Demo functionality 31-Aug-2004
      Design document 30-Sep-2004

All research activities conclude with a Design document; this will set out how the results of the research are to be incorporated into the software component development. Deliverables will likely be added to this list after the individual activity research plans are published.

Risks

This topic has also been addressed on the AstroGrid web sites (3). The following is directly transferred from there:

Risk Prob'y Impact Comment
Technical
Grid software is late or non-functional M VH will design for this eventuality so that grid services can be replaced by simple web services
OGSA-DAI spec is not adopted M VH same avoidance tactic as above, but this will possibly be more difficult
we need to work with OGSA-DAI people to make sure we understand the software and how we can refactor it into the components after it has been proved
Functional
see the list of Component Risks (4)
Operational
Site too slow M H will replace non-performant code as and when detected
Site not accessible to all users M H must ensure site conforms to accepted accessibility specs
Social
Data centres do not accept AstroGrid software M VH work with data centres from beginning to get the software right in their eyes
Astronomers do not find it easy or natural to use software L M release usable part of portal asap & act on feedback
add workflow quickly
demonstrate and publish real science
US adopts different interoperability standards to Europe L H we are all committed to using the IVOA to ensure future interoperability
Personnel
Senior personnel are lost to project L M PL: replace by other AGLI member
PS: replace by senior scientist on project
PM: replace by TLd and devolve some tasks to other senior members
TLd: spread responsibilities among other Snr Devs
Development personnel are lost to project M L do not concentrate knowledge of component in any one person or location
Difficulty in hiring staff M H so far not a problem
Time & Money
project is late VL H with iterative development, project stops at given date
project is over budget VL H as above: budget will be controlled so that overspending does not happen
costs of h/w or s/w go up M VL project does not rely on outside software; hardware is a minor part of the budget

The assessment of probability and impact above are:

  • VH: very high
  • H: high
  • M: medium
  • L: low
  • VL: very low

The list of risk areas above are:

  • Technical: risks which arise from the technologies chosen
    • hardware
    • software
    • network
  • Functional: risks which arise from the architecture (4)
  • Operational: risks that derive from the delivered system in operation
    • performance
  • Social: risks arising from the communities with which the project is concerned or involved
    • VO world
    • astronomy
    • grid
    • e-science
    • funding
    • institutes
  • Personnel: risks arising from the personnel involved in the project
    • recruitment
    • loss
    • skills
  • Time & Money: risk that we exceed budget or timescales
  • Activity Dependencies: risks arising from activity dependencies

The Functional Risks above enjoy a special position in the Unified Software Development Process. These risks are used to determine which use cases are addressed in any iteration. The philosophy is that high functional risk areas are resolved early in the project rather than later when they can adversely impact deadlines. These risks will be identified prior to each iteration and will be reported in the Project Management work package above.

References

-- TonyLinde - 02 Jan 2003

Edit | Attach | Printable | Raw View | Backlinks: Web, All Webs | History: r9 < r8 < r7 < r6 < r5 | More topic actions
Astrogrid.AgocUpdate moved from Astrogrid.TonyAgocUpdate on 07 Feb 2003 - 11:42 by TonyLinde - put it back
 
AstroGrid Service Click here for the
AstroGrid Service Web
This is the AstroGrid
Development Wiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback