TAP Tables and Views - CSA Guide
TAP TABLES AND VIEWS
The TAP system allows read access to the CSA database concerning CSA products. The available data is arranged into custom tables called 'views' which collect together useful attributes for searching for the data/metadata that you need. The tables below list the views with their column names, descriptions/examples and equivalents in the header metadata and in the old CAIO system.
Here are instructions for using TOPCAT to find this information.
Remember (from metadata page) that to find all the possible values for a column, the ADQL syntax is:
SELECT DISTINCT <column> FROM <view>
For example, to find a list of possible values, for e.g., 'category' column name:
SELECT DISTINCT entity FROM v_parameter
and the results are:
Photon, Instrument, Transformation, Particles, Ion_CNO, Compound, Magnetic_Field, Proton, Electric_Field, Other1, Helium+, Alpha, Electron, Observatory, Oxygen+, Ion
In alphabetical order, the views are:
VIEW NAME |
DESCRIPTION |
|
Dataset information, including dataset IDs, dates, formats, type (e.g. data or graphical) |
||
Inventory data, providing information about data within intervals of time and versions |
||
Dataset reference documents (usually caveat files) associated with dataset IDs |
||
Experiment information such as descriptions, datasets available and contact details |
||
File information such as version numbers and dates ingested |
||
Instrument information including instrument types and measurement types |
||
Descriptions and dates for Cluster and Double Star |
||
Descriptions and dates for each spacecraft, but also describes contextual datasets |
||
Provides metadata about parameters measured or calculated in datasets. |
||
Pre-generated plot information, such as generation date and size of file |
||
Lists of quick look products and image size |
CSA.V_DATASET
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
acknowledgement |
Acknowledgement text for use in publications |
ACKNOWLEDGEMENT |
DATASET.ACK |
allow_overlap |
Whether the dataset allows overlap between files. |
|
DATASET.ALLOW_OVERLAP |
category |
E.g., 'CLUSTER', 'Diagnostics', 'MIRACLE', 'Moments', ... |
|
DATASET.CATEGORY |
compress |
Whether the dataset is compressed: (0 = no, 1 = yes) |
|
DATASET.CATEGORY |
crosscal |
Whether the dataset is a cross-calibration product: (0 = no, 1 = yes) |
|
DATASET.CATEGORY |
data_type |
E.g., CAA_Parameter, CAA_Graphic, ... |
DATA_TYPE[3:] |
|
data_type_id |
Abbreviated data_type, e.g., CP, CG, ... |
DATA_TYPE[0:1] |
|
dataset_caveats |
Caveat dataset_id or 'See User Guide for caveats', ... |
|
DATASET.CATEGORY |
dataset_id |
Unique identifier for the dataset ID, e.g., C1_CP_FGM_SPIN |
DATASET_ID |
DATASET.DATASET_ID |
dataset_reference |
Reference dataset IDs delivered if applicable |
|
|
date_last_file_ingested |
Date that the last file was ingested into the CSA, in ISO time format |
|
DATASET.DATE_LAST_FILE_INGESTED |
date_last_update |
Date that the last file was updated in the CSA, in ISO time format |
|
DATASET.DATE_LAST_UPDATE |
description |
Description of the dataset |
DATASET_DESCRIPTION |
DATASET.DESCRIPTION |
display_order |
Display order in web interface |
|
DATASET.DISPLAY_ORDER |
end_date |
End date of currently ingested data for this dataset |
|
DATASET.END_DATE |
experiments |
Experiments involved in this dataset (multiple for cross-calibration products) |
|
|
file_extension |
Format of the files E.g., .cef, .cdf, .png, ... |
|
DATASET.FILE_EXTENSION |
gui_name |
Name as it appears in the web interface (GUI) |
|
DATASET.GUI_NAME |
ingestion_date |
Earliest ISO time that this dataset was ingested into the CSA |
|
DATASET.INGESTION_DATE |
instruments |
Instrument name plus spacecraft number, e.g., PEACE2, STAFF-SA4 |
|
|
"interval" |
Interval covered by the product, mainly for graphical products, e.g., "24 Hour" |
|
DATASET.INTERVAL |
inventory |
Whether the dataset is represented in the inventory plots: (0 = no, 1 = yes) |
|
DATASET.INVENTORY |
is_cef |
Whether the dataset is a CEF product: (0 = no, 1 = yes) |
|
DATASET.IS_CEF |
is_istp |
Indicates if the dataset is ISTP-compliant and downloadable as an ISTP CDF (0 = no, 1 = yes). |
|
DATASET.IS_ISTP |
key_product |
Indicates if this dataset is shown when GUI Results' "Short List" box is ticked |
|
DATASET.KEY_PRODUCT |
"level" |
Processing level, e.g., Calibrated, Raw, Derived, ... |
PROCESSING_LEVEL |
|
main_group |
Grouping for GUI, e.g., Graphical, Science, ... |
|
DATASET.MAIN_GROUP |
max_start_file_date |
ISO start time of the chronologically last file in the dataset |
|
DATASET.MAX_START_FILE_DATE |
max_time_resolution |
Maximum time resolution, in seconds |
|
DATASET.MAX_TIME_RESOLUTION |
measurement_types |
E.g., Magnetic_Field, Energetic_Particles |
|
|
min_time_resolution |
Minimum time resolution, in seconds |
|
DATASET.MIN_TIME_RESOLUTION |
multi_inst |
Indicates if this dataset is multi-instrument: (0 = no, 1 = yes) |
|
DATASET.MULTI_INST |
multi_sc |
Indicates if this dataset is multi-spacecraft: (0 = no, 1 = yes) |
|
DATASET.MULTI_SC |
observatory_name |
Name of spacecraft, e.g., Cluster-4, DoubleStar-1, ... |
|
OBSERVATORY.NAME |
on_demand |
Indicates if this dataset is on demand: (0 = no, 1 = yes) |
|
DATASET.ON_DEMAND |
person_reference |
PI Team personnel/contact information |
CONTACT_COORDINATES |
|
pregen_product |
Indicates if this dataset is a pre-generated product: (0 = no, 1 = yes) |
|
DATASET.PREGEN_PRODUCT |
quicklook_product |
Indicates if this dataset is a quick-look product: (0 = no, 1 = yes) |
|
DATASET.QUICK_LOOK_PRODUCT |
released |
Indicates if this dataset is a released product: (0 = no, 1 = yes) |
|
DATASET.RELEASED |
start_date |
Start date of dataset, ISO time |
|
DATASET.START_DATE |
time_resolution |
Time resolution in seconds |
|
DATASET.TIME_RESOLUTION |
title |
Technical title of dataset, may or may not be same as gui_name |
DATASET_TITLE |
DATASET.TITLE |
unit_name |
E.g., Bitmap, Particle Energy Flux, Raw, ... |
|
DATASET.UNIT_NAME |
CSA.V_DATASET_INVENTORY
No equivalents in header metadata
COLUMN NAME |
EXAMPLE |
CAIO ATTRIBUTE |
dataset_id |
E.g., 'C1_CP_FGM_SPIN' |
DATASET_INVENTORY.DATASET_ID |
end_time |
End of interval, ISO time |
DATASET_INVENTORY.END_TIME |
inventory_version |
Interval data version number |
DATASET_INVENTORY.VERSION |
num_instances |
Number of data points in the interval, integer |
DATASET_INVENTORY.NUM_INSTANCES |
start_time |
Start of interval, ISO time |
DATASET_INVENTORY.START_TIME |
CSA.V_DATASET_REFERENCED
No equivalents in header metadata
COLUMN NAME |
DESCRIPTION/EXAMPLE |
CAIO ATTRIBUTE |
dataset_id |
Dataset ID |
|
dataset_referenced_id |
Reference document dataset ID |
|
mandatory |
Mandatory delivery if applicable: (0 = no, 1 = yes) |
REFERENCED_DATASET.MANDATORY |
CSA.V_EXPERIMENT
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
caveats |
Caveat dataset ID or descriptive caveats |
EXPERIMENT_CAVEATS |
|
datasets |
List of datasets from this experiment |
|
|
description |
Description of experiment |
EXPERIMENT_DESCRIPTION |
EXPERIMENT.DESCRIPTION |
display_order |
Display order in the web interface |
|
EXPERIMENT.DISPLAY_ORDER |
end_date |
Final date of data for this experiment in ISO time |
|
EXPERIMENT.END_DATE |
investigators |
Experiment investigator contact details |
INVESTIGATOR_COORDINATES |
|
key_persons |
Key personnel contact details |
EXPERIMENT_KEY_PERSONNEL |
|
long_name |
Full experiment name, e.g., PEACE electron spectrometer |
|
EXPERIMENT.LONG_NAME |
mission |
Cluster or Double Star |
|
|
name |
Experiment acronym, e.g., PEACE |
EXPERIMENT |
EXPERIMENT.NAME |
"references" |
Reference publications |
EXPERIMENT_REFERENCES |
|
start_date |
Start date of data for this experiment in ISO time |
|
EXPERIMENT.START_DATE |
CSA.V_FILE
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
backup |
Indicates if this file is backed up, (0 = no, 1 = yes) |
|
|
caa_ingestion_date |
Date that the file was ingested into the CAA, ISO time |
|
FILE.CAA_INGESTION_DATE |
compressed |
Indicates if this file is compressed (0 = no, 1 = yes) |
|
FILE.COMPRESSED |
csa_ingestion_date |
Date that the file was ingested into the CSA, ISO time |
|
FILE.CSA_INGESTION_DATE |
dataset_id |
Dataset ID |
|
FILE.DATASET_ID |
dataset_version |
File dataset version |
|
FILE.DATASET_VERSION |
date_last_update |
Date that this file was last updated, ISO time |
|
FILE.DATE_LAST_UPDATE |
distribution_path |
Folder within package |
|
FILE.DISTRIBUTION_PATH |
extension |
Extension of the file, e.g., cef.gz |
|
FILE.EXTENSION |
file_end_date |
End time of the file, ISO time |
FILE_TIME_SPAN |
FILE.END_DATE |
file_name |
Full file name |
|
FILE.FILE_NAME |
file_size |
KB |
|
FILE.FILE_SIZE |
file_start_date |
Start time of the file, ISO time |
FILE_TIME_SPAN |
FILE.START_DATE |
file_type |
Format of the file, e.g., cef |
FILE_TYPE |
FILE.FILE_TYPE |
logical_file_id |
Filename without extension |
LOGICAL_FILE_ID |
FILE.LOGICAL_FILE_ID |
time_coverage_in_sc |
File coverage time in seconds |
|
|
version_number |
File version number, integer |
VERSION_NUMBER |
FILE.VERSION_NUMBER |
CSA.V_INSTRUMENT
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
datasets |
Instrument's dataset IDs |
|
|
description |
Instrument's description |
INSTRUMENT_DESCRIPTION |
INSTRUMENT.DESCRIPTION |
experiment_name |
Experiment name (acronym) |
|
|
instrument_types |
Instrument type, e.g., Antenna, Waveform_Receiver |
INSTRUMENT_TYPE |
INSTRUMENT_TYPE.TYPE |
measurement_types |
Measurement types, e.g., Radio_and_Plasma_Waves, Magnetic_Field |
MEASUREMENT_TYPE |
MEASUREMENT_TYPE.TYPE |
name |
Experiment name (acronym) + spacecraft number, e.g., PEACE2, HID-D2 |
INSTRUMENT_NAME |
INSTRUMENT.NAME |
observatories |
Spacecraft + number, e.g., DoubleStar-2, Cluster-4 (csa.v_observatory.name) |
OBSERVATORY |
OBSERVATORY.NAME |
CSA.V_MISSION
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
agency |
ESA or CNSA_and_ESA |
MISSION_AGENCY |
MISSION.AGENCY |
description |
Mission description |
MISSION_DESCRIPTION |
MISSION.DESCRIPTION |
end_date |
Mission end date, ISO time |
MISSION_TIME_SPAN{21:] |
MISSION.END_DATE |
name |
Cluster or DoubleStar |
MISSION |
MISSION.NAME |
start_date |
Mission start date, ISO time |
MISSION_TIME_SPAN[:20] |
MISSION.START_DATE |
CSA.V_OBSERVATORY
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
abbreviation |
C1-4, D1-2, CC for contextual and CM for all Cluster spacecraft |
|
OBSERVATORY.ABBREVIATION |
description |
Description of s/c including COSPAR ID, dates, orbits, etc. |
|
OBSERVATORY.DESCRIPTION |
instruments |
Instrument names, acronym + s/c number (csa.v_instrument.name) |
|
|
mission_name |
Mission name: Cluster or DoubleStar |
MISSION |
|
name |
Mission and spacecraft number: e.g., Cluster-1 or DoubleStar-2 |
OBSERVATORY |
OBSERVATORY.NAME |
time_span |
Observatory operating time span, ISO time interval |
OBSERVATORY_TIME_SPAN |
OBSERVATORY.TIME_SPAN |
CSA.V_PARAMETER
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
array_dimension |
Numbered dimensions of the array, e.g. for 1D = 0:20, 2D = 0:21, 1:3 |
SIZES |
|
cat_description |
Description of parameter |
CATDESC |
PARAMETER.CAT_DESC |
caveat |
Parameter caveat e.g., "This assumes that the source is dipolar…" |
PARAMETER_CAVEATS |
PARAMETER.CAVEAT |
coordinate_system |
E.g., GSE>Geocentric Solar Ecliptic |
COORDINATE_SYSTEM |
PARAMETER.COORDINATE_SYSTEM |
dataset_id |
Dataset ID, e.g. C1_CP_EDI_AEDC |
|
|
data_type |
Data or Support_Data |
PARAMETER_TYPE |
PARAMETER.TYPE |
delta_minus |
A floating point number or parameter_id |
DELTA_MINUS |
PARAMETER.DELTA_MINUS |
delta_plus |
A floating point number or parameter_id |
DELTA_PLUS |
PARAMETER.DELTA_PLUS |
display_type |
Time_Series or Spectrogram |
DISPLAYTYPE |
PARAMETER.DISPLAY_TYPE |
entity |
The subject, e.g., Electron, Magnetic_Field, etc. |
ENTITY |
PARAMETER.ENTITY |
error_minus |
Parameter ID of error |
ERROR_MINUS |
PARAMETER.ERROR_MINUS |
error_plus |
Parameter ID of error |
ERROR_PLUS |
PARAMETER.ERROR_PLUS |
field_name |
Parameter name, e.g, Electron Gyrofrequency, Ion Count Rates, etc |
FIELD_NAME |
PARAMETER.FIELD_NAME |
fillval |
Value used as a fill value for gaps in data |
FILLVAL |
PARAMETER.FILL_VAL |
fluctuations |
E.g., Waveform, Wavelet_Cross_Spectrum |
FLUCTUATIONS |
PARAMETER.FLUCTUATIONS |
frame |
scalar>na, FAC>xyz, … |
FRAME |
PARAMETER.FRAME |
frame_origin |
Observatory |
|
PARAMETER.FRAME_ORIGIN |
frame_velocity |
Inertial or Observatory |
FRAME_VELOCITY |
PARAMETER.FRAME_VELOCITY |
label_axis |
Axis label, e.g., UT, Mag Field, etc |
LABLAXIS |
PARAMETER.LABEL_AXIS |
parameter_data |
Lists of e.g., energy levels or frequencies |
DATA |
|
parameter_dependency |
Numbered list of dependencies on other parameters |
DEPEND_0 |
|
parameter_id |
Parameter name + dataset_id, e.g., time_tags__C1_CP_EDI_AEDC |
|
PARAMETER.PARAMETER_ID |
parameter_label |
Numbered list of labels for parameter, e.g., 1:Bz, 1:By, 1:Bx for magnetic field |
|
|
parameter_representation |
1:x, 1:y, 1:z or 2:xx, 2:yy, 2:zz |
REPRESENTATION_1 |
|
property |
Property being measured, e.g., Vector, Magnitude, Raw_Particle_Counts, etc |
PROPERTY |
PARAMETER.PROPERTY |
quality |
Integer from 0-3, or parameter ID, e.g., status__C1_CP_EDI_SPIN |
QUALITY |
PARAMETER.QUALITY |
scale_max |
A floating point number |
|
PARAMETER.SCALE_MAX |
scale_min |
A floating point number |
|
PARAMETER.SCALE_MIN |
scale_type |
Linear or Log |
|
PARAMETER.SCALE_TYPE |
si_conversion |
Conversion from data units to SI units, e.g. for nT: 1.0E-9>T |
SI_CONVERSION |
PARAMETER.SI_CONVERSION |
significant_digits |
Number of significant digits |
SIGNIFICANT_DIGITS |
PARAMETER.SIGNIFICANT_DIGITS |
target_system |
FAC or GSE>Geocentric Solar Ecliptic |
|
PARAMETER.TARGET_SYSTEM |
tensor_order |
If the parameter is a tensor, the order of that tensor |
TENSOR_ORDER |
PARAMETER.TENSOR_ORDER |
units |
Units of the parameter |
UNITS |
PARAMETER.UNITS |
value_type |
Data type, i.e., FLOAT, INT or CHAR |
VALUE_TYPE |
PARAMETER.VALUE_TYPE |
CSA.V_PREGEN_INVENTORY
No equivalents in header or CAIO.
COLUMN NAME |
DESCRIPTION/EXAMPLE |
compressed |
0, 1 |
experiment_name |
Experiment acronym, e.g., PEACE, CIS-CODIF |
file_name |
PNG filename |
file_size |
File size in bytes |
ingestion_date |
Date of ingestion (generation) |
"interval" |
DAILY, MONTHLY or YEARLY |
observatory_name |
Spacecraft, e.g., Cluster-1, (csa.v_observatory.name) |
start_date |
Start date within plot |
to_regenerate |
0, 1 |
CSA.V_QUICK_LOOK_DATASET
No equivalents in header or CAIO.
COLUMN NAME |
DESCRIPTION/EXAMPLE |
dataset_id |
Dataset ID of quick look product |
height |
Height in pixels |
max_height |
Maximum height in pixels |
max_width |
Maximum width in pixels |
ql_display_order |
Order to display in GUI |
width |
Width in pixels |