Astrogrid WebData and Database Management Documents
Database Task Force, OGSA-DAI, Grid-related
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| DBTF Scoping study | Dave Pearson (Oracle) | 2002 Feb 8 | Study of requirements for a grid-enabled database which led to OGSA-DAI project | |
| AstroGrid comments on DBTF Scoping Study | Bob Mann | 2002 Feb 8 | HTML | Detailed comments on Pearson report by various AstroGrid people |
| DatabaseServiceNotesApril2002 | Guy Rixon | 2002 Apr 2 | HTML | Notes on database access via the grid - leading to OGSA-DAI |
| GridDataHandleDefinitions | Guy Rixon | 2002 Sep 20 | Wiki | Suggested syntax for grid data handles |
| ThirdPartyGridFTP | Guy Rixon | 2002 Oct 11 | Wiki | How a server can get two clients to exchange files |
| OgsaDaiQuestionnaire | Dave Pearson | 2002 Dec 06 | Wiki | Questionnaire for early adopters of OGSA-DAI |
Scientific Requirements
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| XMMUsageScenarios | Mike Watson | 2002 Dec 11 | Wiki | XMM-Newton science cases and use-cases |
| BrownDwarfSearch | Clive Page | 2004 Feb 10 | Wiki | Analysis of actual science research case: how to find brown dwarf stars in the Hyades cluster, with SQL statements |
| BrownDwarfQuestions | Clive Page | 2004 Feb 15 | Wiki | Questions arising from BrownDwarfSearch - how could this be done by the VO? |
Database Requirements for Astrogrid
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| DBMS Evaluation Criteria | Clive Davenhall et al | 2002 Mar 2 | HTML | Study of requirements for DBMS - query language, functionality, tests to perform |
| Querying Astronomical Catalogues with the VO | Clive Davenhall | 2002 Mar 25 | HTML | Types of queries that the VO should support |
| DBMStoEvaluate | Clive Page | 2002 Apr 19 | HTML | Suggested list of DBMS that we should evaluate |
| VOTable home page | Clive Davenhall | 2002 Apr 1 | HTML | Links to VOTable documentation and associated material |
| DatabaseDiscussion | Clive Page | 2002 May 9 | HTML | Discussion of range of issues concerning databases for the VO |
| DataMiningFacility | Clive Page et al | 2003 Jan 09 | Wiki | Draft functional requirements for a simple data mining facility |
Study of other data archives
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| Existing VO Prototypes | WP4 team | 2002 Feb 15 | HTML | Study of online archive services around the world with comments |
Spatial Data Handling - cone-search and cross-matching
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| SkyIndexing: proposed PCODE algorithm | Clive Page | 2002 May 9 | HTML | Discusses 1-D and 2-D indexing, R-trees, Z-order index, HTM and HEALPix coding and how to do cone-search and spatial-join |
| SpatialIndexing Revisited | Clive Page | 2002 Nov 18 | Wiki | Comparing results of R-tree and PCODE in practice, plus comments by Bob Mann; see also DataCentreSpatialIndexing |
| DataFederation | Clive Page | 2003 Jun 11 | Wiki | Cross-matching catalogues - requirements, possible ways to implement, notes on what Vizier can do at present |
| DataFederationCases | Clive Page | 2003 Jul 09 | Wiki | Science cases which require catalogue cross-matching or similar |
| DataFedeReport | Patricio Ortiz | 2003 Sep 26 | Wiki | How to merge results from distributed cone-searches |
| DataFederationandDataMining | Clive Page | 2003 Sep 26 | Wiki | Report summarising previous work on cross-search and cross-matching catalogues, with notes on DBMS limitations, performance enhancements, etc. |
| Report on Cross-Matching Catalogues | Clive Page | 2003 Sep 29 | HTML | Report on cross-matching catalogues using DB2, MySQL, and PostgreSQL |
| DataFederationTool | Patricio Ortiz | 2003 Oct 21 | Wiki | Description of tool which merges VOTables coming from distributed cone-searches |
| DataCentreSpatialIndexing (revised) | Clive Page | 2004 Feb 25 | Wiki | Further discussion of cone-search and spatial join using R-tree or PCODE methods |
| PixelCodeSizes | Clive Page | 2004 March 23 | Wiki | How to choose pixel sizes for HEALPix and HTM |
| DistributedCrossMatch discussion document | Clive Page | 2004 Apr 6 | Wiki | Problem of doing spatial joins across the network, notes on how JHU do it |
| ConeSearchResults | Clive Page | 2004 July 8 | Wiki | Examples of the heterogeneous results you get when you do a distributed cone-search: maybe this isn't scientifically useful? |
| CrossMatchAlgorithms updated | Clive Page | 2004 Sept 15 | Wiki | Notes on plane sweep algorithm from CSIRO |
| CrossMatchingCatalogues Proposed Implementation | Clive Page | 2004 Dec 23 | HTML | Describes new asymmetric pixel-code algorithm |
Evaluations of various RDBMS
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| DbmsEvaluations | Clive Page | 2002 Aug 8 | HTML | Summary of our tests of MySQL, Postgres, Oracle, SQL Server, and DB2 |
| DB2 DbmsOnCluster | Patricio Ortiz | 2003 Jan 31 | Wiki | Brief details of DB2 installation on hydra |
| SybaseIQnotes | Clive Page | 2003 Apr 10 | Wiki | Capabilities and performance notes on Sybase-IQ product - with Jim Lewis (IoA) |
| PostgresSpatial | Clive Page | 2004 Feb 10 | Wiki | How to use PostgreSQL when handling spatial data, use R-tree indices, etc. |
| NotesOnDBMS - MySQL, Postgres, and DB2 | Clive Page | 2004 Feb 17 | Wiki | List of standard and non-standard SQL statements for common operations on three DBMS |
| NotesOnpgAstro | Clive Page | 2004 Mar 23 | Wiki | Experience of using pgSphere a spatial indexing system for Postgres which understands spherical-polar coordinates |
Query Language
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| DBMSmathFunctions | Clive Page | 2004 Jan 15 | Wiki | List of mathematical functions required by VOQL and whether JDBC and various DBMS support them (or if names are different) |
| SuggestionsForADQL | Clive Page | 2004 Apr 29 | Wiki | Proposed extra syntax for ADQL/VOQL - some now included in spec |
| ThoughtsOnXMATCH | Clive Page et al | 2004 May 11 | Wiki | How to implement XMATCH function in ADQL |
| RegistryQL | Clive Page | 2004 Jun 22 | Wiki | Suggestions for queries the Registry ought to handle |
Miscellaneous
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| VOTableCompressionTests | Guy Rixon | 2002 Jun 18 | HTML | How to compress VOTable - discussion of xmill and gzip |
| UsefulSymbols in HTML pages | Clive Page | 2003 Feb 26 | Wiki | Off topic: Greek letters and math symbols which you can use, with IE/Mozilla compatibility |
| GridDataWarehouse contents | Clive Page | 2004 Apr 5 | Wiki | Links to GDW pages |
| GdwCataloguesIteration4 | Clive Page | 2004 Apr 5 | Wiki | List of tables and their columns installed on hydra/cass123 in It4 |
| CelestialCoordinates | Clive Page | 2004 Aug 12 | Wiki | Guide to celestial coordinates, cone-search etc. for non-astronomers |
Papers published externally
| Title | Author | Date | Format | Brief Description |
|---|---|---|---|---|
| JoiningSourceCatalogues using DBMS (ADASS paper) | Clive Page | 2002 Nov 7 | HTML | How do cone-search and spatial join by R-trees and PCODE method |
| Federating Datasets with Spatial Joins (ADASS03 paper) | Clive Page | 2003 Nov 28 | ADASS paper on R-tree vs PCODE method, and on Postgres vs MySQL | |
| Report on Databases for AVO | Clive Page | 2004 Jan 14 | Summary of work on DBMS, data federation, and associated issues |
Show attachments
Hide attachments
| I | Attachment | Action | Size | Date | Who | Comment |
|---|---|---|---|---|---|---|
 html | crossmatch.html | manage | 40.7 K | 06 Jan 2005 - 17:08 | ClivePage | describes new asymmetric pixel-code algorithm |
 |
Click here for the AstroGrid Service Web |
This is the AstroGrid Development Wiki |
|
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding TWiki? Send feedback