Grid Data Warehouse

A place on AstroGrid to combine tables from many databases. The warehouse allows data-mining of federated catalogues to proceed without requiring distributed joins. Thus, the warehouse allows the data-mining system to have useful performance.

The warehouse is a new feature of the AstroGrid infrastructure. Work was begun in iteration 4 of AstroGrid phase B, at the start of October 2003.

This page is an index to GDW pages. The original page "GridDataWarehouse" which had the information in-line, is archived at GdwEarlyDiscussions, but will becoming progressively out of date. New material should be added to this page and its dependents.

Data-sets for the warehouse

• GdwCataloguesIteration4: catalogues to be loading into the warehouse prototype made in iteration 4.

Design

• GdwDesignIteration4: design of the warehouse prototype in iteration 4.
• GridDataWarehouseResourceEntry: metadata for the warehouse to suit AstroGrid's registry of services.
• GdwRefactoringForOgsadai: how we are refactoring the package to ease access to Globus and OGSA-DAI.

Reports from meetings

• Notes on a possible data-warehouse design, from the research-group meeting at Cambridge on 2003-09-30.
• Notes from the Grid Research telecon on 2003-10-01.

Tools for use with the warehouse

• GdwFederationTools: prototypes for data federation tools.

Plans and reports

• AgRa06Grid

Iteration 4 release

• SoftwareRelease
• GdwTroubleshooting