A note on the catalogues provided in Iteration 4:
| catalogue |
Rows |
Columns |
Format |
Notes |
| 1XMM (first XMM-Newton) |
56,711 |
379 |
FITS binary table |
cgp has utility to convert to CSV |
| FIRST object catalogues |
811117 |
15 |
IoA has file suitable for MySQL |
should be ok for Postgres |
| INT WFS object catalogues |
71,638,904 |
28 |
Binary FITS tables |
Will be concatenated into one table |
| 2MASS |
177,757,299 |
61 |
compressed CSV |
Northern Hemisphere only designed to ingest into Postgres/Mysql |
| USNOB-1 |
408,567,041 |
51 |
binary strips |
Northern Hemisphere only cgp has utility to convert to CSV |
Below is a listing of the tables stored on hydra in Postgres at the start of Iteration 6. The same set of tables is also stored on cass123.
dw=# \d
List of relations
| Schema |
Name |
Type |
Owner |
| public |
first |
table |
eca |
| public |
intwfs |
table |
cgp |
| public |
twomass |
table |
cgp |
| public |
usnob |
table |
cgp |
| public |
xmm1 |
table |
eca |
FIRST - Radio Catalog from VLA
Website
http://sundog.stsci.edu/first/catalogs.html
dw=# \d first
Table "public.first"
| Column |
Type |
Modifiers |
Units |
UCD |
| ra |
double precision |
|
deg |
POS_EQ_RA_MAIN |
| decl |
double precision |
|
deg |
POS_EQ_RA_MAIN |
| code_quality |
character(1) |
|
|
CODE_MIST |
| phot_flux_peak |
double precision |
|
mJy |
PHOT_FLUX_RADIO_1.4G |
| phot_flux_int |
double precision |
|
mJy |
PHOT_FLUX_RADIO_1.4G |
| phot_flux_error |
double precision |
|
mJy |
INST_NOISE |
| extension_fwhm_maj |
double precision |
|
arcsec |
EXTENSION_FWHM_MAJ |
| extension_fwhm_min |
double precision |
|
arcsec |
EXTENSION_FWHM_MIN |
| pos_posang |
double precision |
|
deg |
POS_POS-ANG |
| extension_fwhm_maj_fit |
double precision |
|
arcsec |
EXTENSION_FWHM_MAJ |
| extension_fwhm_min_fit |
double precision |
|
arcsec |
EXTENSION_FWHM_MIN |
| pos_posang_fit |
double precision |
|
deg |
POS_POS-ANG |
| id_field |
character(12) |
|
|
ID_IMAGE |
| errbox |
box |
not null |
|
|
| hpix |
integer |
|
|
|
|
Indexes:
- "fbox" rtree (errbox)
- "fdec" btree (decl)
- "hind" btree (hpix)
dw=# select count(*),min(ra),max(ra),min(decl),max(decl) from first;
Time: 9137.781 ms
INT-WFS Isaac-Newton Telescope Wide Field Survey
dw=# \d intwfs
Table "public.intwfs"
| Column |
Type |
Modifiers |
| no_ |
real |
|
| isophotal_flux |
real |
|
| total_flux |
real |
|
| core_flux |
real |
|
| x_coordinate |
real |
|
| y_coordinate |
real |
|
| gaussian_sigma |
real |
|
| ellipticity |
real |
|
| position_angle |
real |
|
| peak_height |
real |
|
| areal_1_profile |
real |
|
| areal_2_profile |
real |
|
| areal_3_profile |
real |
|
| areal_4_profile |
real |
|
| areal_5_profile |
real |
|
| areal_6_profile |
real |
|
| areal_7_profile |
real |
|
| areal_8_profile |
real |
|
| core1_flux |
real |
|
| core2_flux |
real |
|
| core3_flux |
real |
|
| core4_flux |
real |
|
| ra |
double precision |
|
| decl |
double precision |
|
| classification |
real |
|
| statistic |
real |
|
| filename |
character varying |
|
| errbox |
box |
|
Indexes:
- "ibox" rtree (errbox)
- "idec" btree (decl)
dw=# select count(*),min(ra),max(ra),min(decl),max(decl) from intwfs;
Time: 524932.177 ms
2MASS - Two-micron All Sky Survey
dw=# \d twomass
Table "public.twomass"
| No. |
Column |
Type |
Modifiers |
| 1 |
ra |
double precision |
not null |
| 2 |
decl |
double precision |
not null |
| 3 |
err_maj |
real |
|
| 4 |
err_min |
real |
|
| 5 |
err_ang |
smallint |
|
| 6 |
designation |
character(17) |
|
| 7 |
j_m |
real |
|
| 8 |
j_cmsig |
real |
|
| 9 |
j_msigcom |
real |
|
| 10 |
j_snr |
real |
|
| 11 |
h_m |
real |
|
| 12 |
h_cmsig |
real |
|
| 13 |
h_msigcom |
real |
|
| 14 |
h_snr |
real |
|
| 15 |
k_m |
real |
|
| 16 |
k_cmsig |
real |
|
| 17 |
k_msigcom |
real |
|
| 18 |
k_snr |
real |
|
| 19 |
ph_qual |
character(3) |
|
| 20 |
rd_flg |
character(3) |
|
| 21 |
bl_flg |
character(3) |
|
| 22 |
cc_flg |
character(3) |
|
| 23 |
ndet |
character(6) |
|
| 24 |
prox |
real |
|
| 25 |
pxpa |
smallint |
|
| 26 |
pxcntr |
integer |
|
| 27 |
gal_contam |
smallint |
|
| 28 |
mp_flg |
smallint |
|
| 29 |
pts_key |
integer |
|
| 30 |
hemis |
character(1) |
|
| 31 |
date |
date |
|
| 32 |
scan |
smallint |
|
| 33 |
glon |
real |
|
| 34 |
glat |
real |
|
| 35 |
x_scan |
real |
|
| 36 |
jdate |
double precision |
|
| 37 |
j_psfchi |
real |
|
| 38 |
h_psfchi |
real |
|
| 39 |
k_psfchi |
real |
|
| 40 |
j_m_stdap |
real |
|
| 41 |
j_msig_stdap |
real |
|
| 42 |
h_m_stdap |
real |
|
| 43 |
h_msig_stdap |
real |
|
| 44 |
k_m_stdap |
real |
|
| 45 |
k_msig_stdap |
real |
|
| 46 |
dist_edge_ns |
integer |
|
| 47 |
dist_edge_ew |
integer |
|
| 48 |
dist_edge_flg |
character(2) |
|
| 49 |
dup_src |
smallint |
|
| 50 |
use_src |
smallint |
|
| 51 |
a |
character(1) |
|
| 52 |
dist_opt |
real |
|
| 53 |
phi_opt |
smallint |
|
| 54 |
b_m_opt |
real |
|
| 55 |
vr_m_opt |
real |
|
| 56 |
nopt_mchs |
smallint |
|
| 57 |
ext_key |
integer |
|
| 58 |
scan_key |
integer |
|
| 59 |
coadd_key |
integer |
|
| 60 |
coadd |
smallint |
|
| 61 |
errbox |
box |
not null |
Indexes:
- "tbox" rtree (errbox)
- "tdec" btree (decl)
dw=# select count(*),min(ra),max(ra),min(decl),max(decl) from twomass;
Time: 1005774.435 ms
USNO-B US Naval Observatory Catalog release B.1
dw=# \d usnob
Table "public.usnob"
| Column |
Type |
Modifiers |
| id |
character(10) |
not null |
| ra |
double precision |
not null |
| decl |
double precision |
not null |
| e_ra |
real |
not null |
| e_de |
real |
not null |
| epoch |
real |
not null |
| pmra |
smallint |
not null |
| pmde |
smallint |
not null |
| mupr |
real |
not null |
| e_pmra |
smallint |
not null |
| e_pmde |
smallint |
not null |
| fit_ra |
real |
not null |
| fit_de |
real |
not null |
| ndet |
smallint |
not null |
| flags |
character(3) |
not null |
| b1mag |
real |
|
| b1c |
smallint |
|
| b1s |
smallint |
|
| b1f |
smallint |
|
| b1sg |
smallint |
|
| b1xi |
real |
|
| b1eta |
real |
|
| r1mag |
real |
|
| r1c |
smallint |
|
| r1s |
smallint |
|
| r1f |
smallint |
|
| r1sg |
smallint |
|
| r1xi |
real |
|
| r1eta |
real |
|
| b2mag |
real |
|
| b2c |
smallint |
|
| b2s |
smallint |
|
| b2f |
smallint |
|
| b2sg |
smallint |
|
| b2xi |
real |
|
| b2eta |
real |
|
| r2mag |
real |
|
| r2c |
smallint |
|
| r2s |
smallint |
|
| r2f |
smallint |
|
| r2sg |
smallint |
|
| r2xi |
real |
|
| r2eta |
real |
|
| nmag |
real |
|
| nc |
smallint |
|
| ns |
smallint |
|
| nf |
smallint |
|
| nsg |
smallint |
|
| nxi |
real |
|
| neta |
real |
|
| errbox |
box |
not null |
Indexes:
- "ubox" rtree (errbox)
- "udec" btree (decl)
dw=# select count(*),min(ra),max(ra),min(decl),max(decl) from usnob;
Time: 1766166.438 ms
1XMM - First XMM-Newton Catalogue
dw=# \d xmm1
Table "public.xmm1"
| Column |
Type |
Modifiers |
| srcindex |
integer |
|
| unique_srcnum |
integer |
|
| xmmsrcname |
character(21) |
|
| obs_id |
integer |
|
| revolut |
smallint |
|
| date_obs |
character(19) |
|
| date_end |
character(19) |
|
| mjd_obs |
double precision |
|
| mjd_end |
double precision |
|
| duration |
real |
|
| procdate |
character(19) |
|
| ppsvers |
character(24) |
|
| seq_id |
smallint |
|
| m1_set |
character(100) |
|
| m2_set |
character(100) |
|
| pn_set |
character(100) |
|
| m1_filter |
character(7) |
|
| m2_filter |
character(7) |
|
| pn_filter |
character(7) |
|
| m1_submode |
character(32) |
|
| m2_submode |
character(32) |
|
| pn_submode |
character(32) |
|
| m1_expid |
character(4) |
|
| m2_expid |
character(4) |
|
| pn_expid |
character(4) |
|
| m1_exposure |
double precision |
|
| m2_exposure |
double precision |
|
| pn_exposure |
double precision |
|
| m1_scts |
real |
|
| m1_scts_err |
real |
|
| m2_scts |
real |
|
| m2_scts_err |
real |
|
| pn_scts |
real |
|
| pn_scts_err |
real |
|
| m1_bg_map |
real |
|
| m2_bg_map |
real |
|
| pn_bg_map |
real |
|
| m1_flux |
real |
|
| m1_flux_err |
real |
|
| m2_flux |
real |
|
| m2_flux_err |
real |
|
| pn_flux |
real |
|
| pn_flux_err |
real |
|
| m1_rawx |
integer |
|
| m1_rawy |
integer |
|
| m1_ccdnr |
integer |
|
| m2_rawx |
integer |
|
| m2_rawy |
integer |
|
| m2_ccdnr |
integer |
|
| pn_rawx |
integer |
|
| pn_rawy |
integer |
|
| pn_ccdnr |
integer |
|
| m1_ra |
double precision |
|
| m1_dec |
double precision |
|
| m1_lii |
double precision |
|
| m1_bii |
double precision |
|
| m2_ra |
double precision |
|
| m2_dec |
double precision |
|
| m2_lii |
double precision |
|
| m2_bii |
double precision |
|
| pn_ra |
double precision |
|
| pn_dec |
double precision |
|
| pn_lii |
double precision |
|
| pn_bii |
double precision |
|
| m1_dist_nn |
real |
|
| m2_dist_nn |
real |
|
| pn_dist_nn |
real |
|
| sum_src_num |
integer |
|
| m1_ml_id_src |
integer |
|
| m2_ml_id_src |
integer |
|
| pn_ml_id_src |
integer |
|
| ra |
double precision |
|
| decl |
double precision |
|
| radec_err |
real |
|
| lii |
double precision |
|
| bii |
double precision |
|
| ra_corr |
double precision |
|
| dec_corr |
double precision |
|
| lii_corr |
double precision |
|
| bii_corr |
double precision |
|
| m1_tot |
real |
|
| m1_tot_err |
real |
|
| m2_tot |
real |
|
| m2_tot_err |
real |
|
| pn_tot |
real |
|
| pn_tot_err |
real |
|
| m1_1 |
real |
|
| m1_1_err |
real |
|
| m1_2 |
real |
|
| m1_2_err |
real |
|
| m1_3 |
real |
|
| m1_3_err |
real |
|
| m1_4 |
real |
|
| m1_4_err |
real |
|
| m1_5 |
real |
|
| m1_5_err |
real |
|
| m2_1 |
real |
|
| m2_1_err |
real |
|
| m2_2 |
real |
|
| m2_2_err |
real |
|
| m2_3 |
real |
|
| m2_3_err |
real |
|
| m2_4 |
real |
|
| m2_4_err |
real |
|
| m2_5 |
real |
|
| m2_5_err |
real |
|
| pn_1 |
real |
|
| pn_1_err |
real |
|
| pn_2 |
real |
|
| pn_2_err |
real |
|
| pn_3 |
real |
|
| pn_3_err |
real |
|
| pn_4 |
real |
|
| pn_4_err |
real |
|
| pn_5 |
real |
|
| pn_5_err |
real |
|
| m1_xid |
real |
|
| m1_xid_err |
real |
|
| m2_xid |
real |
|
| m2_xid_err |
real |
|
| pn_xid |
real |
|
| pn_xid_err |
real |
|
| m1_det_ml |
real |
|
| m2_det_ml |
real |
|
| pn_det_ml |
real |
|
| ep_det_ml |
real |
|
| m1_1_exp |
real |
|
| m1_2_exp |
real |
|
| m1_3_exp |
real |
|
| m1_4_exp |
real |
|
| m1_5_exp |
real |
|
| m2_1_exp |
real |
|
| m2_2_exp |
real |
|
| m2_3_exp |
real |
|
| m2_4_exp |
real |
|
| m2_5_exp |
real |
|
| pn_1_exp |
real |
|
| pn_2_exp |
real |
|
| pn_3_exp |
real |
|
| pn_4_exp |
real |
|
| pn_5_exp |
real |
|
| m1_hr1 |
real |
|
| m1_hr1_err |
real |
|
| m1_hr2 |
real |
|
| m1_hr2_err |
real |
|
| m1_hr3 |
real |
|
| m1_hr3_err |
real |
|
| m2_hr1 |
real |
|
| m2_hr1_err |
real |
|
| m2_hr2 |
real |
|
| m2_hr2_err |
real |
|
| m2_hr3 |
real |
|
| m2_hr3_err |
real |
|
| pn_hr1 |
real |
|
| pn_hr1_err |
real |
|
| pn_hr2 |
real |
|
| pn_hr2_err |
real |
|
| pn_hr3 |
real |
|
| pn_hr3_err |
real |
|
| errbox |
box |
not null |
|
Indexes:
- "xdec" btree (decl)
- "xmmbox" rtree (errbox)
dw=# select count(*),min(ra),max(ra),min(decl),max(decl) from xmm1;
Time: 1394.354 ms
Note that the execution times given above were for hydra; times for cass123 are slower, sometimes up to four times slower.
The units of RA and DECL are degrees in every case (as may be seen from the ranges). For twomass and usnob only the northern hemisphere was loaded (because of shortage of disc space). The units of the other columns may be found from inspection of the corresponding tables held in Vizier, except for intwfs, which is described here:
http://www.ast.cam.ac.uk/~wfcsur/index.php
--
ClivePage - 04 May 2004