{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# TAP access to CSA metadata\n", "\n", "To install [astroquery](https://astroquery.readthedocs.io/en/latest/index.html) ([Ginsburg et al, 2019](https://doi.org/10.3847/1538-3881/aafc33)) to be able to use [TAP+](https://astroquery.readthedocs.io/en/latest/utils/tap.html):\n", "\n", "`conda install -c astropy astroquery`\n", "\n", "The different missions have their own TAP servers; Cluster's is:\n", "`https://csa.esac.esa.int/csa-sl-tap/tap/`" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Tables: metadata of metadata\n", "\n", "First of all, it's helpful to know what tables are there. \n", "\n", "From example 1.1 on [Astroquery TAP page](https://astroquery.readthedocs.io/en/latest/utils/tap.html), load the table objects using the method `load_tables()`, then print the names of those table objects using the `get_qualified_name()` method. This returns the schema (e.g., csa.) and the table names (e.g., csa.dataset). We only need to focus on the `csa.` schema tables." ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Created TAP+ (v20200428.1) - Connection:\n", "\tHost: csa.esac.esa.int\n", "\tUse HTTPS: True\n", "\tPort: 443\n", "\tSSL Port: 443\n", "INFO: Retrieving tables... [astroquery.utils.tap.core]\n", "INFO: Parsing tables... [astroquery.utils.tap.core]\n", "INFO: Done. [astroquery.utils.tap.core]\n", "csa.csa.array_dimension\n", "csa.csa.cluster_data_type\n", "csa.csa.dataset\n", "csa.csa.dataset_contact\n", "csa.csa.dataset_inventory\n", "csa.csa.dataset_referenced\n", "csa.csa.experiment\n", "csa.csa.experiment_dataset\n", "csa.csa.file\n", "csa.csa.instrument_type\n", "csa.csa.measurement_type\n", "csa.csa.news\n", "csa.csa.observatory\n", "csa.csa.parameter\n", "csa.csa.parameter_data\n", "csa.csa.parameter_dependency\n", "csa.csa.parameter_label\n", "csa.csa.parameter_representation\n", "csa.csa.pregen_inventory\n", "csa.csa.processing_level\n", "csa.csa.v_dataset\n", "csa.csa.v_dataset_inventory\n", "csa.csa.v_dataset_referenced\n", "csa.csa.v_experiment\n", "csa.csa.v_file\n", "csa.csa.v_instrument\n", "csa.csa.v_mission\n", "csa.csa.v_observatory\n", "csa.csa.v_parameter\n", "csa.csa.v_pregen_inventory\n", "csa.csa.v_quick_look_dataset\n", "graphics.graphics.distribution_panel\n", "graphics.graphics.panel\n", "graphics.graphics.pregen_file\n", "public.public.dual\n", "tap_config.tap_config.coord_sys\n", "tap_config.tap_config.properties\n", "tap_schema.tap_schema.columns\n", "tap_schema.tap_schema.key_columns\n", "tap_schema.tap_schema.keys\n", "tap_schema.tap_schema.schemas\n", "tap_schema.tap_schema.tables\n" ] } ], "source": [ "from astroquery.utils.tap.core import TapPlus\n", "\n", "CSA = TapPlus(url=\"https://csa.esac.esa.int/csa-sl-tap/tap/\")\n", "tables = CSA.load_tables()#only_names=True)\n", "\n", "for table in tables:\n", " print(table.get_qualified_name())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "From the above list of tables, the helpful ones are those beginning `csa.csa.` and the ones meant for users begin with `csa.csa.v_`, where the 'v' means 'view'. The view tables contain the same information as the other `csa.csa.` tables but the columns in those tables might be grouped slightly differently, and the columns containing information meant for internal database use have been taken out since they are of no use to the end-user.\n", "\n", "The schema (the first `csa.`) isn't needed when making the query.\n", "\n", "Also from [Astroquery TAP page](https://astroquery.readthedocs.io/en/latest/utils/tap.html), load a specific table and print out the column names. " ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Retrieving table 'csa.v_parameter'\n", "\n", " Table: \n", " TAP Table name: csa.csa.v_parameter\n", "Description: \n", "Num. columns: 37 \n", "\n", "Column names: \n", "array_dimension\n", "cat_description\n", "caveat\n", "compound\n", "compound_definition\n", "coordinate_system\n", "dataset_id\n", "data_type\n", "delta_minus\n", "delta_plus\n", "display_type\n", "entity\n", "error_minus\n", "error_plus\n", "field_name\n", "fillval\n", "fluctuations\n", "frame\n", "frame_origin\n", "frame_velocity\n", "label_axis\n", "parameter_data\n", "parameter_dependency\n", "parameter_id\n", "parameter_label\n", "parameter_representation\n", "property\n", "quality\n", "scale_max\n", "scale_min\n", "scale_type\n", "si_conversion\n", "significant_digits\n", "target_system\n", "tensor_order\n", "units\n", "value_type\n" ] } ], "source": [ "table = CSA.load_table('csa.v_parameter')\n", "\n", "print('\\n Table: \\n', table, '\\n')\n", "\n", "print('Column names: ')\n", "for column in (table.columns):\n", " print(column.name)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Querying Tables - accessing metadata\n", "\n", "So far we have only been loading metadata of the metadata, so we need to make an actual query to get the values:\n", "\n", "From [AppDynamics](https://docs.appdynamics.com/display/PRO45/ADQL+Queries) rather than [Astronomical Data Query Language](https://www.ivoa.net/documents/ADQL/2.0), but still usefully put:\n", "\n", "`SELECT * | {[DISTINCT] expression [AS alias] [, expression [AS alias]]...}\n", "FROM event_type\n", "[WHERE condition_expression]\n", "[SINCE timevalue [UNTIL timevalue]]\n", "[HAVING condition_expression]\n", "[ORDER BY {field_name | alias} [ASC | DESC] [, {field_name | alias} [ASC | DESC]]...]\n", "[LIMIT integer [, integer]...]`\n", "\n", "While the SELECT and FROM clauses are required, all other clauses are optional. Type spaces around each keyword. \n", "\n", "### Whole table\n", "\n", "To see all the columns and first 2000 rows (TAP+ has a synchronous request limit of 2000) of a table:" ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "scrolled": true }, "outputs": [ { "data": { "text/html": [ "Table length=2000\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
acknowledgementallow_overlapcategorycompresscrosscaldataset_caveatsdataset_iddataset_referencedataset_versiondata_typedata_type_iddate_last_file_ingesteddate_last_updatedescriptiondisplay_orderend_dateexperimentsfile_extensiongui_nameingestion_dateinstrumentsintervalinventoryis_cefis_istpkey_productlevelmain_groupmax_start_file_datemax_time_resolutionmeasurement_typesmin_time_resolutionmulti_instmulti_scobservatory_nameon_demandperson_referencepregen_productquicklook_productreleasedstart_datetime_resolutiontitleunit_name
objectint16objectint16int16objectobjectobjectobjectobjectobjectobjectobjectobjectint32objectobjectobjectobjectobjectobjectobjectint16boolboolint16objectobjectobjectfloat64objectfloat64int16int16objectint16objectint16int16int16objectfloat64objectobject
Please acknowledge the instrument team and ESA Cluster Active \n", " Archive in any publication based upon use of this data.0General00*D1_CQ_STA-DWP_PSD_CAVD1_CG_STA-DWP_COMBI_PNGD1_CQ_STA-DWP_PSD_CAV (1)CAA_GraphicCG2018-11-22T19:55:10.971Z2020-11-10T03:22:28.202ZThis dataset contains 1 minute resolution Power Spectral Density \n", " measurements of the magnetic field in two bands. The lower band \n", " contains 33 frequencies distributed linearly between 2Hz and 10Hz, \n", " while the upper band contains 27 frequencies distributed\n", " logarithmically between 20 Hz and 4 kHz. It is measured \n", " along a single axis orientated for minimum interference.300202007-09-30T00:00:00.000ZSTAFF-DWPpngPlot (24 hr) - 1D SA/SC Power Spectra Density (2-4000 Hz, 1-min) [png]2018-01-18T09:41:53.279ZDWP-D124 hour0FalseFalse0CalibratedGraphical2007-09-29T00:00:00.000Z--Magnetic_Field, Radio_and_Plasma_Waves--00DoubleStar-10KH Yearby>DWP Technical Manager>K.H.Yearby@sheffield.ac.uk0112004-02-10T00:00:00.000Z86400.0Power Spectral Density (1 minute resolution) (png)Bitmap
Please acknowledge the CIS team and ESA Cluster Science Archive when using this data.0Particle Distribution10*C4_CQ_CIS-CODIF_CAVEATSC4_CP_CIS-CODIF_HS_O1_PEFC4_CQ_CIS-CODIF_CAVEATS (1)CAA_ParameterCP2021-04-10T22:56:10.556Z2021-04-11T02:14:43.366ZThis dataset contains CIS-CODIF 3D Oxygen+ distributions\n", "for the High-Sensitivity side of spacecraft C4, in Particle_Energy_Flux units56402020-12-31T23:59:59.000ZCIScefO+ 3D distribution (High sensitivity)2011-11-29T16:36:29.375ZCIS-CODIF41TrueTrue0CalibratedScience2020-12-31T00:00:00.000Z4.0Ion_Composition, Thermal_Plasma, Energetic_Particles16.000Cluster-40Iannis Dandouras>PI>Iannis.Dandouras@irap.omp.eu ---- Henri Reme>Deputy-PI>Henri.Reme@irap.omp.eu0012001-01-01T00:00:00.000Z4.0CIS-CODIF 3D Oxygen+ distributions on C4, High-Sensitivity, in Particle_Energy_FluxParticle Energy Flux
Please acknowledge the ESA Cluster Active Archive in any \n", " publication based upon use of this data0General10See User Guide for caveatsC4_CG_AUX_CAA_6HR_PARTICLES1_PSCAA_GraphicCG2021-08-03T06:17:06.672Z2021-03-05T03:21:48.631ZThis plot, available for each spacecraft, is based on the calibrated CAA data and has a similar layout \n", " as the corresponding CSDSweb plot (that is based on default calibration values). \n", " The panels from top to bottom are:\n", " Total magnetic field (FGM)\n", " Total ion velocity (CIS-HIA)\n", " Polar angle of Ion velocity (CIS-HIA)\n", " Azimuthal angle of ion velocity (CIS-HIA)\n", " Total ion density (CIS-HIA)\n", " Ion energy spectra (CIS)\n", " Electron energy spectra (PEACE)301602020-10-01T00:00:00.000ZAUXps6-hr CAA Summary Plot (Particles1)2015-03-03T16:41:46.471ZAUX40FalseFalse0CalibratedGraphical2020-09-30T18:00:00.000Z21600.0Status21600.000Cluster-40caaops>Non-PI>caaops@sciops.esa.int0012001-01-01T00:00:00.000Z21600.06-hr CAA Summary Plot (Particles1)Postscript
Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data.0Particle Distribution10*C1_CQ_PEA_CAVEATSC1_CP_PEA_3DXLARH_DEFluxC1_CQ_PEA_CAVEATS (1)CAA_ParameterCP2020-11-21T23:31:04.288Z2020-11-22T03:12:08.413ZThis dataset contains all available 3DF, 3DX and 3DXE data from the PEACE HEEA\n", "sensor on the Cluster C1 spacecraft in LAR mode only. This dataset\n", "is NOT summed over polar angle but can in some cases be summed over energy. Including:\n", "- The 3DF dataset contains FULL resolution three dimensional electron distribution.\n", "- The 3DX1 and 3DX2 datasets contains the variable resolution three dimensional\n", "electron distribution with no summing.\n", "- The 3DXE1 and 3DXE2 datasets contains the variable resolution three dimensional\n", "electron distribution which has been summed over pairs of ENERGY bins.\n", "\n", "For the 3DX in LAR mode the extent of the data structure (including flyback\n", "information) will be 16 azimuths x 12 polar angles x 64 energy bins.53302019-12-31T23:59:59.000ZPEACEcefElectron 3D distribution (best resolution, LAR mode, HEEA sensor)2011-12-30T15:03:19.977ZPEACE11TrueTrue0CalibratedScience2019-01-01T00:00:00.000Z12.0Thermal_Plasma1260.000Cluster-10Andrew Fazakerley>a.fazakerley@ucl.ac.uk>Principal Investigator0012000-11-28T00:00:00.000Z12.0PEACE 3DXLARH data from the HEEA sensorParticle Energy Flux
Please acknowledge the CIS team and ESA Cluster Science Archive when using this data.0Particle Distribution10*C3_CQ_CIS-CODIF_CAVEATSC3_CP_CIS-CODIF_RPA_He1_RCC3_CQ_CIS-CODIF_CAVEATS (1)CAA_ParameterCP2015-07-20T09:56:01.195Z2020-11-10T03:21:22.144ZThis dataset contains CIS-CODIF 3D Helium+ distributions\n", "for RPA mode on spacecraft C3 in Raw_Particle_Counts units54302010-01-01T00:00:00.000ZCIScefHe+ 3D distribution (RPA mode)2011-11-29T16:42:08.078ZCIS-CODIF30TrueTrue0RawScience2009-01-01T00:00:00.000Z4.0Ion_Composition, Thermal_Plasma, Energetic_Particles16.000Cluster-30Iannis Dandouras>PI>Iannis.Dandouras@irap.omp.eu ---- Henri Reme>Deputy-PI>Henri.Reme@irap.omp.eu0012001-01-01T00:00:00.000Z4.0CIS-CODIF 3D Helium+ distributions on C3, RPA ModeRaw
Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data.0Pitch Angle10*C3_CQ_PEA_CAVEATSC3_CP_PEA_PITCH_3DXPAL_DEFluxC3_CQ_PEA_CAVEATS (1)CAA_ParameterCP2020-11-21T23:31:15.080Z2021-06-24T11:06:29.876ZThis data product contains rebinned pitch angle distributions from a single (LEEA) sensor for\n", "the Cluster C3 spacecraft. The data is provided in the same format as the 3D data, except that\n", "the 12 polar zones are rebinned into 12 pitch angle zones using ground calibrated magnetic field\n", "data. Only MAR and HAR sweep modes are included. Only the 3DX azimuths that are most closely\n", "aligned parallel and anti-parallel with the onboard magnetic field direction are included.42202019-12-31T23:59:59.000ZPEACEcefElectron Pitch Angle distribution (enhanced resolution, LEEA sensor)2011-11-29T16:39:10.713ZPEACE31TrueTrue0DerivedScience2019-01-01T00:00:00.000Z4.0Thermal_Plasma4.000Cluster-30Andrew Fazakerley>a.fazakerley@ucl.ac.uk>Principal Investigator0012000-09-13T00:00:00.000Z4.0PEACE PITCH_3DXPAL data from the LEEA sensorParticle Energy Flux
Please acknowledge the EFW team and the ESA Cluster Active Archive in any\n", "publication based upon use of these data0General10C1_CP_EFW_L1_P34CAA_ParameterCP2016-10-01T03:19:05.159Z2020-11-10T03:20:37.117ZThis dataset contains measurements of the\n", "Potential difference measured between probes 3 and 4\n", "from the EFW experiment on the Cluster C1 spacecraft151802020-01-01T00:00:00.000ZEFWcefPotential, Probe 3 to Probe 42011-12-30T15:03:59.059ZEFW10TrueFalse0CalibratedAncillary2009-10-15T00:00:00.000Z0.002222Electric_Field0.0400Cluster-10Mats Andre>PI>Mats.Andre@irfu.se0012001-02-01T00:00:00.000Z0.04Potential difference measured between probes 3 and 4
Please acknowledge the EDI team and ESA\n", "Cluster Active Archive in any publication based upon use of this data0General10C3_CQ_EDI_ANOMALY_AECAA_Quality/CaveatsCQ2018-11-28T19:53:16.115Z2021-03-26T12:15:47.701ZThis dataset contains time ranges for outliers in ambient electrons mode and reason that caused it.\n", "Measurements are provided by two detector units and the status of these units is represented by one value.\n", "The range for this value is from 0 to 3. The values have the following meaning:\n", "0 = data ok\n", "1 = detector 1 data not ok\n", "2 = detector 2 data not ok\n", "3 = data from both detectors not ok\n", "Optionally an explanation is provided as a text150802012-02-21T23:59:59.000ZEDIcefAE mode anomalies2018-11-20T10:45:03.521ZEDI31TrueFalse0UncalibratedAncillary2001-01-01T00:00:00.000Z--Electric_Field--00Cluster-30MikhailRashev>Archive Scientist>rashev@mps.mpg.de0012001-01-01T00:00:00.000Z--ANOMALY LIST for AE mode
Please acknowlegde the CIS instrument team and\n", "ESA Cluster Active Archive when using this data.0Particle Distribution10C3_CP_CIS-HIA_HS_SW_IONS_RCC3_CQ_CIS-HIA_CAVEATS (1)CAA_ParameterCP2017-04-21T07:07:10.779Z2020-11-10T03:21:23.149ZThis dataset contains 3D Ion distributions in Raw_Particle_Counts units\n", "from the CIS-HIA instrument on Cluster C3 spacecraft\n", "in High-Sensitivity and Solar-Wind Mode50802009-11-11T23:59:59.000ZCIScefIon 3D distribution (High sensitivity, Solar Wind mode)2011-11-29T16:41:16.971ZCIS-HIA30TrueTrue0RawScience2009-11-11T00:00:00.000Z4.0Thermal_Plasma, Energetic_Particles16.000Cluster-30Iannis Dandouras>PI>Iannis.Dandouras@cesr.fr ---- Henri Reme>Deputy-PI>Henri.Reme@cesr.fr0012001-01-01T00:00:00.000Z4.03D Ion distributions for CIS-HIA, High-Sensitivity, Solar-Wind ModeRaw
Please acknowledge the instrument team and ESA Cluster Science Archive in any\n", "publication based upon use of this data.0General10See User Guide for general caveat information.\n", "*C2_CQ_DWP_PCOR_FX\n", "This caveat list is complemented by the PEACE operational log.\n", "www.mssl.ucl.ac.uk/missions/cluster/about_operations/PEACE_ops_history.phpC2_CP_DWP_PCOR_FXCAA_ParameterCP2021-08-05T22:27:57.993Z2021-08-20T02:15:40.118ZThe DWP particle correlator data sets provide the result of the\n", "onboard autocorrelation of the PEACE HEEA count rate. Due to\n", "telemetry restrictions, only two of the possible 16 correlator\n", "energy channels are returned. One data set, PCOR_FX (this file)\n", "provides ACFs at a fixed energy whilst the other PCOR_ST data\n", "set steps through the remaining energy steps at a rate of one\n", "step per spin. The 32 ACF lag values provide count rate\n", "information in the range 1.4-41.6kHz at a particular energy. In\n", "normal mode, one ACF is produced every spin where as in burst\n", "modes there may be either 4, 8, or 16 ACFs per spin depending\n", "upon the WEC operational mode implemented. In addition to the\n", "ACF and energy, this data set also contains the HEEA polar\n", "sensor from which the data were collected, the azimuth of\n", "observations (BM only), the maximum and minimum pitch angles of\n", "the electrons recorded and an estimate of the count rate based\n", "on the ACF. For further details, the user is referred to the\n", "DWP User Manual, available from CSA, which contains a complete\n", "description of all parameters within the data set as well as a\n", "list of the general caveats that apply to this data set.102020-02-29T23:59:59.000ZDWPcefParticle Correlator High Resolution Data, fixed energy band2021-02-18T12:02:20.201ZDWP21TrueFalse0DerivedScience2020-02-29T00:00:00.000Z0.22Status4.400Cluster-20K Yearby>Instrument Manager>K.H.Yearby@sheffield.ac.uk ---- S Walker>Data Manager>Simon.Walker@sheffield.ac.uk ---- A M Buckley>DWP correlator scientist>A.M.Buckley@sussex.ac.uk0012001-01-01T00:00:00.000Z4.0DWP Particle Correlator High Resolution Data, fixed energy band
....................................................................................................................................
Please acknowledge the European Union Framework 7 Programme, the MAARBLE project\n", "and the ESA Cluster Archive in any publications based upon the use of these data.0CLUSTER10To be writtenC3_CP_AUX_MAARBLE_ULF_PC12CAA_ParameterCP2018-08-10T19:10:02.139Z2020-11-10T03:21:15.142ZBB is the spectrum of B produced using Morlet wavelet in FAC system.\n", "Polarization and propagation parameters derived from singular value\n", "decomposition (SVD) method of the cross-spectral matrix (sm).\n", "The SVD method is described in Santolik et al (2003).\n", "The parameters calculated from the three magnetic components are\n", "BB, KSVD, ELLSVD, PLANSVD and POLSVD.\n", "KSVD is the wave vector (polar and azimuthal angles) in FAC system.\n", "DOP is the 3D degree of polarization defined in Samson (1973).\n", "PV is the Poynting vector (magnitude, polar and azimuthal angles)\n", "in FAC coordinate system.\n", "ESUM is the sum of the two electric auto-power spectra in\n", "the spacecraft spin plain.\n", "BMAG is the magnitude of DC magnetic field measured by FGM.\n", "\n", "The parameters are derived from the following CAA datasets:\n", "- C3_CP_FGM_FULL_ISR2 for B,\n", "- C3_CP_EFW_L2_E for E.\n", "The change of coordinate system has been done using FGM data.\n", "\n", "This dataset was generated as part of the MAARBLE (Monitoring,\n", "Analyzing and Assessing Radiation Belt Energization and Loss)\n", "collaborative research project which has received funding from the\n", "European Community's Seventh Framework Programme (FP7-SPACE-2011-1)\n", "under grant agreement n. 284520.\n", "\n", "The contacts for the MAARBLE project are\n", "Ioannis A. Daglis, National Observatory of Athens\n", "Yuri Khotyaintsev, Swedish Institute of Space Physics\n", "Ondrej Santolik, Institute of Atmospheric Physics of\n", "the Academy of Sciences of the Czech Republic\n", "Sebastien Bourdarie, ONERA\n", "Richard B. Horne, The British Antarctic Survey\n", "Ian R. Mann, The University of Alberta\n", "Drew Turner, UCLA530102011-02-24T03:27:00.000ZAUXcefMAARBLE: Pc 1-2 Wave Spectra and PP Parameters2014-05-16T13:58:40.236ZAUX31TrueFalse0DerivedMAARBLE2011-02-23T23:30:00.000Z1.0Status1.000Cluster-30Meghan Mella>Cluster ULF data provider>meghan.mella@irfu.se ---- Yuri Khotyaitsev>MAARBLE Wave Database leader>yuri@irfu.se0012001-02-04T11:40:00.000Z1.0Pc 1-2 Wave Spectra, Polarization and Propagation Parameters
Please acknowledge the CIS team and ESA Cluster Science Archive when using this data.0Particle Distribution10*C3_CQ_CIS-CODIF_CAVEATSC3_CP_CIS-CODIF_RPA_He2_PFC3_CQ_CIS-CODIF_CAVEATS (1)CAA_ParameterCP2015-07-20T09:55:33.407Z2020-11-10T03:21:22.142ZThis dataset contains CIS-CODIF 3D Alpha distributions\n", "for RPA mode on spacecraft C3 in Differential_Particle_Flux units55602010-01-01T00:00:00.000ZCIScefHe++ 3D distribution (RPA mode)2011-11-29T16:56:40.999ZCIS-CODIF30TrueTrue0CalibratedScience2009-01-01T00:00:00.000Z4.0Ion_Composition, Thermal_Plasma, Energetic_Particles16.000Cluster-30Iannis Dandouras>PI>Iannis.Dandouras@irap.omp.eu ---- Henri Reme>Deputy-PI>Henri.Reme@irap.omp.eu0012001-01-01T00:00:00.000Z4.0CIS-CODIF 3D Alpha distributions on C3, RPA ModeParticle Flux
Please acknowledge the ESA Cluster Active Archive in any publication based upon\n", " the use of this data.0General01C1_CG_MULT_COMP_B_EDI_FGMCAA_GraphicCG2019-06-20T20:41:04.225Z2021-08-10T02:13:43.796ZThe plot contains five panels. The first panel shows the total magnetic field \n", " measured by FGM (black) and by EDI (red) in nano Teslas. The latter is calculated \n", " from electron gyrotime. The second panel shows the difference between the two \n", " instantenous measurements (black) and their median value for each minute (red). \n", " The difference is calculated only when the two measurements are collected within \n", " 50 millisecond. The third panel shows the FGM Range value. The fourth panel shows \n", " the EDI code repetition frequency. The bottom panel shows the elevation angle of \n", " the magnetic field vector measured by FGM from the spacecraft spin plane.\n", " The datasets used for this plot include:\n", " C1_CP_FGM_FULL_ISR2: for FGM magnetic field vector and Range value\n", " C1_CP_EDI_EGD: for EDI electron gyrotime\n", " C1_CP_EDI_CRF: for EDI code repetition frequency300402010-01-24T04:00:00.000ZEDI, FGMpngMagnetic Field Comparison: EDI vs FGM2016-03-01T15:27:36.611ZEDI1, FGM11 hour1FalseFalse0CalibratedGraphical2010-01-24T03:00:00.000Z3600.0Electric_Field, Magnetic_Field3600.010Cluster-10caaops>Non-PI>caaops@sciops.esa.int0112001-02-02T08:00:00.000Z3600.0Magnetic Field Comparison: EDI vs FGMBitmap
Please acknowledge the EFW team and the ESA Cluster Active Archive in any\n", "publication based upon use of these data0Science10This dataset has been calculated using the following products:\n", "- C4_CP_FGM_FULL\n", "- CL_SP_AUX\n", "- C4_CP_AUX_POSGSE_1M\n", "This dataset has a varying time resolution:\n", "25 vectors per second for normal mode (NM1) and 450 vectors per second for burst mode (BM1).\n", "The mode intervals are given in 'Telemetry Mode'dataset (see Spacecraft auxiliary datasets).\n", "\n", "The timing can be inaccurate if the TCOR is not applied:\n", "*C4_CQ_DWP_TCORC4_CP_EFW_L2_E3D_INERTC4_CQ_DWP_TCOR (1)CAA_ParameterCP2021-07-11T06:29:43.625Z2021-07-11T02:10:59.543ZThis dataset contains instantaneous values of the 3-dimensional Electric field\n", "vector in the inertial frame (i.e., vxB removed) in the spacecraft coordinate\n", "system (ISR2), using EFW electric field data from C4_CP_EFW_L2_E and FGM\n", "magnetic field data from C4_CP_FGM_FULL that are interpolated to the time\n", "stamps of electric field data. The spin-axis component of the electric field is\n", "calculated with assumption of E.B equals 0 and with use of 2 electric field\n", "components measured in the spin plane and three magnetic field components.\n", "If the magnetic field component along the spin axis is less than 2 nT or the\n", "elevation angle of the magnetic field vector from the spacecraft spin plane is less\n", "than 15 degrees, the spin-axis electric field component has a FILLVAL.\n", "\n", "Detailed quality information is provided as a 16 bit set of flags\n", "in the parameter E_bitmask__C4_CP_EFW_L2_E3D_INERT. The meaning of\n", "the bits is as follows (LSB numbering starting at 0):\n", "Bit 0: Reset.\n", "Bit 1: Bad bias.\n", "Bit 2: Probe latchup.\n", "Bit 3: Low density saturation (-68V).\n", "Bit 4: Sweep (collection and dump).\n", "Bit 5: Burst dump.\n", "Bit 6: Non-standard operations (NS_OPS).\n", "Bit 7: Manual flag.\n", "Bit 8: Not used.\n", "Bit 9: Not used.\n", "Bit 10: Solar wind wake correction applied.\n", "Bit 11: Lobe wake.\n", "Bit 12: Plasmaspheric wake.\n", "Bit 13: Whisper operating.\n", "Bit 14: Saturation due to high bias current.\n", "Bit 15: Bias current DAC not responding correctly.\n", "Bit 16: Saturation due to probe shadow.20602018-02-01T00:00:00.000ZEFWcef3D Electric field in ISR2 (E.B=0) (full resolution)2011-11-29T16:35:30.252ZEFW41TrueTrue1CalibratedScience2018-01-31T00:00:00.000Z0.002222Electric_Field0.0400Cluster-40caateam>Non-PI>caateam@cosmos.esa.int0012001-02-01T00:00:00.000Z0.043D Electric field in ISR2 (E.B=0) (full resolution)
Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data.0General10*C2_CQ_PEA_CAVEATSC2_CP_PEA_OMSLC2_CQ_PEA_CAVEATS (1)CAA_ParameterCP2020-11-21T23:30:28.289Z2020-11-22T03:12:14.396ZThis data product contains the 'moments sums' calculated onboard from 3DR data\n", "for the PEACE LEEA sensor on the Cluster C2 spacecraft.\n", "\n", "CAUTION!\n", "\n", "Onboard moment sums are NOT moments, and are not intended for science use without\n", "further processing. They are included in the CAA for completeness.\n", "Scientific moments data derived from these data are available elsewhere in CAA.\n", "\n", "The measured energy range may be divided in up to different parts as follows:\n", "The overlap region is the energy range measured by both HEEA and LEEA during the spin.\n", "The top region is the energy range above the overlap region measured by only one sensor.\n", "The bottom region is the energy range below the overlap region measured by only one sensor.\n", "\n", "The data variables are then split up as follows:\n", "Top Region refers to the top region data collected during the whole spin.\n", "OverlapFirstHalf refers to the overlap region data collected during the first half of the spin.\n", "OverlapSecondHalf refers to the overlap region data collected during the second half of the spin.\n", "Bottom Region refers to the bottom region data collected during the whole spin.\n", "\n", "Some or all of the 4 regions will be populated depending on the commanded sensor energy coverage.150302019-12-31T23:59:59.000ZPEACEcefMoments Sums (LEEA sensor)2011-11-29T16:46:15.600ZPEACE21TrueFalse0CalibratedAncillary2019-12-31T00:00:00.000Z4.0Thermal_Plasma4.000Cluster-20Andrew Fazakerley>a.fazakerley@ucl.ac.uk>Principal Investigator0012000-11-12T00:00:00.000Z4.0PEACE OMSL data from the LEEA sensor
Please acknowledge the WBD team, NASA and ESA Cluster Active Archive in any publication based upon use of this data0General10DATASET VERSION HISTORY\n", "=======================\n", "V01/02 - Initial delivery and conversion of WBD waveform data\n", "Created Mar 2008. Revised Dec 2008, Jan 2010\n", "...\n", "(the ISTP global metadata included in the source CDF is given below)\n", "...\n", "TITLE[0]: CLUSTER WBD\n", "Project[0]: ISTP>International Solar-Terrestrial Physics\n", "Discipline[0]: Space Physics>Magnetospheric Science\n", "Source_name[0]: C4>Cluster spacecraft 4\n", "Data_type[0]: waveform\n", "Descriptor[0]: WBD>Wide Band Data Plasma Wave Receiver\n", "ADID_ref[0]: NSSD0171\n", "Logical_source[0]: c1_waveform_wbd\n", "Logical_source_description[0]: Cluster Wideband Data Plasma Wave Receiver/High Time Resolution Waveform Data\n", "PI_name[0]: 2006 - Current: J. S. Pickett; 1988 - 2006: D. A. Gurnett\n", "PI_affiliation[0]: The University of Iowa\n", "Mission_group[0]: Cluster\n", "Instrument_type[0]: Radio and Plasma Waves (space)\n", "HTTP_LinearK[0]: http://www-pw.physics.uiowa.edu/cluster/\n", "HTTP_LinearK[1]: http://www.cosmos.esa.int/web/csa/\n", "LinearK_TITLE[0]: Cluster Wideband Plasma Wave Investigation\n", "LinearK_TITLE[1]: Cluster Active Archive\n", "Acknowledgement[0]: Users of the Cluster WBD data are encouraged to acknowledge NASA Goddard Space Flight Center and The University of Iowa as the source of the data in any publication.\n", "Rules_of_use[0]: Cluster WBD data are open to everyone. However, users of these data are encouraged to contact the PI Institute should questions arise.\n", "Time_resolution[0]: 1.0/Sample_rate\n", "LinearK_TEXT[0]: Overview and high time resolution spectrograms, documentation, and data coverage files\n", "LinearK_TEXT[1]: High time resolution spectrograms, documentation, and data coverage files\n", "File_naming_convention[0]: source_datatype_descriptorC4_CP_WBD_WAVEFORM_BM2CAA_ParameterCP2020-07-09T00:22:52.905Z2020-11-10T03:22:04.168ZHigh time resolution calibrated waveform data sampled in one of 3 frequency\n", "bands in the range 0-577 kHz along one axis using either an electric field\n", "antenna or a magnetic search coil sensor. The dataset also includes instrument\n", "mode, data quality and the angles required to orient the measurement with\n", "respect to the magnetic field and to the GSE coordinate system.\n", "...\n", "The Burst Mode (BM) dataset contains the data that has been returned via\n", "the main Cluster telemetry system using BM2. The format of the file is\n", "to the waveform product returned via the dedicated communication link except\n", "that there is an additional paramter providing information on the data\n", "sampling and bandwidth relveant for the BM2 link.\n", "...\n", "CALIBRATION:\n", "...\n", "The procedure used in computing the calibrated Electric Field and Magnetic\n", "Field values found in this file can be obtained from the document\n", "'cluster_wbd_calibration.pdf'. Because the calibration was applied in the time\n", "domain using a simple equation the raw counts actually measured by the WBD\n", "instrument can be obtained by using these equat ions and solving for\n", "'Raw Counts', keeping in mind that this number is an Integer ranging\n", "from 0 to 255. Since DC offset is a real number, the resultant when solving\n", "for raw counts will need to be converted to the nearest whole number.\n", "...\n", "CONVERSION TO FREQUENCY DOMAIN:\n", "...\n", "In order to convert the WBD data to the frequency domain via an FFT, the\n", "following steps need to be carried out:\n", "1) If Electric Field, first divide calibrated data values by 1000 to get V/m;\n", "2) Apply window of preference, if any (such as Hanning, etc.);\n", "3) Divide data values by sqrt(2) to get back to the rms domain;\n", "4) perform FFT (see Bandwidth variable notes for non-continuous modes);\n", "5) divide by the noise bandwidth, which is equal to the sampling frequency\n", "divided by the FFT size (see table below for appropriate sampling frequency);\n", "6) multiply by the appropriate constant for the window used, if any.\n", "...\n", "Bandwidth Sample Rate\n", "--------- ------------\n", "9.5 kHz 27.443 kHz\n", "19 kHz 54.886 kHz\n", "77 kHz 219.544 kHz\n", "...\n", "COORDINATE SYSTEM USED:\n", "...\n", "One axis measurements made in the Antenna Coordinate System, i.e., if electric\n", "field measurement, it will either be Ey or Ez, both of which are in the spin\n", "plane of the spacecraft, and if magnetic field measurement, it will either be\n", "Bx, along the spin axis, or By, in spin plane.\n", "...\n", "The burst mode file has the same format as the standard WBD waveform with the\n", "addition of an additional paramter which describes the details of the mode\n", "specification.\n", "The paramter can take one of ten values as specified below\n", "0 = Duty Cycled 9.5 kHz, 1-in-3, Sample Rate 27.443 kHz\n", "1 = Duty Cycled 9.5 kHz, 1-in-4, Sample Rate 27.443 kHz\n", "2 = Duty Cycled 19 kHz, 1-in-3, Sample Rate 54.886 kHz\n", "3 = Duty Cycled 19 kHz, 1-in-4, Sample Rate 54.886 kHz\n", "4 = Duty Cycled 77 kHz, 1-in-3, Sample Rate 219.544 kHz\n", "5 = Duty Cycled 77 kHz, 1-in-4, Sample Rate 219.544 kHz\n", "6 = Digital Filtered 9.5 kHz, 1-in-3, roll-off at 3.2 kHz, SR 9.148 kHz\n", "7 = Digital Filtered 9.5 kHz, 1-in-3, optimized roll-off at 4.2 kHz, SR 9.148 kHz\n", "8 = Digital Filtered 9.5 kHz, 1-in-4, roll-off at 2.5 kHz, SR 6.861 kHz\n", "9 = Digital Filtered 9.5 kHz, 1-in-4, optimized roll-off at 3.1 kHz, SR 6.861 kHz\n", "...302019-09-25T05:19:59.000ZWBDcefElectric and magnetic waveform data (BM2 mode, CEF format)2017-11-27T13:57:01.394ZWBD41TrueTrue0CalibratedScience2019-09-25T05:10:00.000Z3.5e-05Magnetic_Field, Radio_and_Plasma_Waves, Electric_Field3.5e-0500Cluster-40Keith Yearby>Non-PI>k.h.yearby@sheffield.ac.uk0012001-03-07T17:45:21.000Z3.5e-05High time resolution electric and magnetic waveform data taken in Burst Mode (CEF)
Please acknowledge the PEACE team and ESA Cluster Active Archive in any publication based upon use of this data0General10*D2_CQ_PEA_CAVFD2_PP_PEACSDS Prime ParameterPP2015-05-15T12:28:14.062Z2020-11-10T03:22:15.175ZThis dataset contains preliminary spin resolution measurements of the\n", "electron velocity distribution function at the satellite in three dimensions\n", "from the PEACE experiment on the Double Star D2 spacecraft.\n", "These data have been converted into Cluster Exchange Format from the orignal\n", "Double Star Science Data System Common Data Format (CDF) Prime Parameter files\n", "that were made available through the Double Star Science Data System.\n", "The metadata has been updated from the DSDS/CDF standard to the CAA to aid\n", "compatibility with tools developed for the Cluster Active Archive.\n", "\n", "Version 01 of this dataset is the initial translation prepared for the\n", "launch of the CAA during the second half of 2005.150202008-05-30T23:59:59.000ZPEACEcefPreliminary electron moments (spin resolution)2015-04-27T20:54:07.573ZPEACE-D21TrueFalse0CalibratedAncillary2008-05-30T00:00:00.000Z3.636Thermal_Plasma4.41200DoubleStar-20Andrew Fazakerley>PI>anf@mssl.ucl.ac.uk0012004-08-15T00:00:00.000Z4.0Preliminary electron parameters (spin resolution)
Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data.0Pitch Angle10*C2_CQ_PEA_CAVEATSC2_CP_PEA_PITCH_FULL_LAR_DPFluxC2_CQ_PEA_CAVEATS (1)CAA_ParameterCP2020-11-21T23:31:13.071Z2020-11-22T03:12:08.394ZThis data product contains rebinned pitch angle distribution snap-shots for 3 different energy\n", "ranges: top, overlap (LEEA), overlap (HEEA), and bottom, for the Cluster C2 spacecraft. At\n", "least one sensor is in the LAR sweep mode.42602019-12-31T23:59:59.000ZPEACEcefElectron Pitch Angle distribution (Full spin-resolution, LAR mode, HEEA and LEEA sensors)2012-06-19T10:30:49.260ZPEACE21TrueTrue0DerivedScience2019-01-01T00:00:00.000Z4.0Thermal_Plasma4.000Cluster-20Andrew Fazakerley>a.fazakerley@ucl.ac.uk>Principal Investigator0012000-09-01T00:00:00.000Z4.0PEACE PITCH_FULL_LAR data from the HEEA and LEEA sensorsParticle Flux
Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data.0Particle Distribution10*C2_CQ_PEA_CAVEATSC2_CP_PEA_PADLARH_DEFluxC2_CQ_PEA_CAVEATS (1)CAA_ParameterCP2020-11-21T23:31:11.069Z2020-11-22T03:12:14.396ZThis dataset contains the onboard selected pitch angle distribution (PAD) data\n", "from the PEACE HEEA sensor on the Cluster C2 spacecraft during LAR sweep mode only.\n", "Part of the pitch angle distribution is returned during the first half of a spin and the\n", "rest is returned during the second half. The magnetic field direction used to select pitch\n", "angles is provided by FGM over the Inter-Experimental Link (IEL). The combined data from the\n", "first and second half-spins provides the full 0 to 180 degree Pitch Angle coverage.\n", "\n", "For the LAR mode the extent of the data structure (including flyback\n", "information) will be 2 azimuths x 12 polar angles x 64 energy bins.\n", "Only every other energy bin is valid in LAR mode to give 30 non-fill-value energy\n", "bins per azimuth. Odd or even bins are returned on alternate spins.\n", "\n", "NOTE: The onboard pitch angle selection can be unreliable in some situations, including\n", "a rapidly changing magnetic field. Please see supporting PEACE documentation.201902019-12-31T23:59:59.000ZPEACEcefElectron 2D reduced distribution (LAR mode, HEEA sensor)2011-11-29T16:45:20.481ZPEACE21TrueFalse0CalibratedAncillary2019-01-01T00:00:00.000Z4.0Thermal_Plasma4.000Cluster-20Andrew Fazakerley>a.fazakerley@ucl.ac.uk>Principal Investigator0012000-11-12T00:00:00.000Z4.0PEACE PADLARH data from the HEEA sensorParticle Energy Flux
Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data.0Pitch Angle10*C4_CQ_PEA_CAVEATSC4_CP_PEA_PITCH_FULL_DPFluxC4_CQ_PEA_CAVEATS (1)CAA_ParameterCP2021-01-23T23:50:22.195Z2021-01-24T03:13:26.368ZThis data product contains rebinned pitch angle distribution snap-shots for 3 different energy\n", "ranges: top, overlap (LEEA), overlap (HEEA), and bottom, for the Cluster C4 spacecraft. Only\n", "MAR and HAR sweep modes are included.40502019-12-31T23:59:59.000ZPEACEcefElectron Pitch Angle distribution (Full spin-resolution, HEEA and LEEA sensors)2012-06-19T10:29:18.060ZPEACE41TrueTrue0DerivedScience2019-12-31T00:00:00.000Z4.0Thermal_Plasma4.000Cluster-40Andrew Fazakerley>a.fazakerley@ucl.ac.uk>Principal Investigator0012000-09-01T00:00:00.000Z4.0PEACE PITCH_FULL data from the HEEA and LEEA sensorsParticle Flux
" ], "text/plain": [ "\n", " acknowledgement ...\n", " object ...\n", "------------------------------------------------------------------------------------------------------------------------------------------------------------------ ...\n", " Please acknowledge the instrument team and ESA Cluster Active \n", " Archive in any publication based upon use of this data. ...\n", " Please acknowledge the CIS team and ESA Cluster Science Archive when using this data. ...\n", " Please acknowledge the ESA Cluster Active Archive in any \n", " publication based upon use of this data ...\n", " Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data. ...\n", " Please acknowledge the CIS team and ESA Cluster Science Archive when using this data. ...\n", " Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data. ...\n", " Please acknowledge the EFW team and the ESA Cluster Active Archive in any\n", "publication based upon use of these data ...\n", " Please acknowledge the EDI team and ESA\n", "Cluster Active Archive in any publication based upon use of this data ...\n", " Please acknowlegde the CIS instrument team and\n", "ESA Cluster Active Archive when using this data. ...\n", " Please acknowledge the instrument team and ESA Cluster Science Archive in any\n", "publication based upon use of this data. ...\n", " ... ...\n", "Please acknowledge the European Union Framework 7 Programme, the MAARBLE project\n", "and the ESA Cluster Archive in any publications based upon the use of these data. ...\n", " Please acknowledge the CIS team and ESA Cluster Science Archive when using this data. ...\n", " Please acknowledge the ESA Cluster Active Archive in any publication based upon\n", " the use of this data. ...\n", " Please acknowledge the EFW team and the ESA Cluster Active Archive in any\n", "publication based upon use of these data ...\n", " Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data. ...\n", " Please acknowledge the WBD team, NASA and ESA Cluster Active Archive in any publication based upon use of this data ...\n", " Please acknowledge the PEACE team and ESA Cluster Active Archive in any publication based upon use of this data ...\n", " Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data. ...\n", " Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data. ...\n", " Please acknowledge the PEACE instrument team\n", "and ESA Cluster Active Archive\n", "in any publication based upon use of this data. ..." ] }, "execution_count": 3, "metadata": {}, "output_type": "execute_result" } ], "source": [ "results = CSA.launch_job(\"SELECT * FROM csa.v_dataset\")\n", "r = results.get_results()\n", "r" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Using WHERE to restrict results\n", "\n", "To get a list of all datasets that include FGM, we need to query the v_dataset table for the dataset_id and add the WHERE statement to restrict the results to those that contain 'FGM'. Remember that the percentage sign (%) is the wildcard, but it doesn't need to be URL encoded here." ] }, { "cell_type": "code", "execution_count": 22, "metadata": {}, "outputs": [ { "data": { "text/html": [ "Table length=98\n", "
\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
dataset_id
object
C3_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PS
C3_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PNG
C1_CG_MULT_COMP_E_HIA_FGM_EFW_PS
C2_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PNG
C2_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PS
C4_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PS
C1_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PS
C4_CP_FGM_SPIN_ISR2
C1_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PNG
C4_CG_MULT_COMP_M_GYRO_FGM_EDI_PNG
...
C1_CP_FGM_5VPS_ISR2
C3_CP_FGM_FULL_ISR2
C2_CP_FGM_FULL_ISR2
C1_CP_FGM_FULL_ISR2
C4_CP_FGM_FULL_ISR2
C2_CP_FGM_5VPS_ISR2
C2_CP_FGM_SPIN_ISR2
C3_CP_FGM_5VPS_ISR2
C1_CP_FGM_SPIN_ISR2
C4_CP_FGM_5VPS_ISR2
" ], "text/plain": [ "\n", " dataset_id \n", " object \n", "------------------------------------\n", " C3_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PS\n", "C3_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PNG\n", " C1_CG_MULT_COMP_E_HIA_FGM_EFW_PS\n", "C2_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PNG\n", " C2_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PS\n", " C4_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PS\n", " C1_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PS\n", " C4_CP_FGM_SPIN_ISR2\n", "C1_CG_MULT_COMP_E_HIA_FGM_EFW_TS_PNG\n", " C4_CG_MULT_COMP_M_GYRO_FGM_EDI_PNG\n", " ...\n", " C1_CP_FGM_5VPS_ISR2\n", " C3_CP_FGM_FULL_ISR2\n", " C2_CP_FGM_FULL_ISR2\n", " C1_CP_FGM_FULL_ISR2\n", " C4_CP_FGM_FULL_ISR2\n", " C2_CP_FGM_5VPS_ISR2\n", " C2_CP_FGM_SPIN_ISR2\n", " C3_CP_FGM_5VPS_ISR2\n", " C1_CP_FGM_SPIN_ISR2\n", " C4_CP_FGM_5VPS_ISR2" ] }, "execution_count": 22, "metadata": {}, "output_type": "execute_result" } ], "source": [ "results = CSA.launch_job(\"SELECT dataset_id FROM csa.v_dataset WHERE dataset_id like '%FGM%'\")\n", "r = results.get_results()\n", "r" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### An inventory file request:\n", "\n", "Request (SELECT) 5 columns FROM csa.v_dataset_inventory table WHERE the dataset_id is 'C1_CP_FGM_SPIN' AND start_time is *before* 1 May 2002 AND end_time is *after* 1 April 2002 and ORDER BY the start time column, and print the results, as text or as an [astropy.table](https://docs.astropy.org/en/stable/table/index.html?highlight=astropy.table):" ] }, { "cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [ { "data": { "text/html": [ "Table length=102\n", "
\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
dataset_idstart_timeend_timenum_instancesinventory_version
objectobjectobjectint32int32
C1_CP_FGM_SPIN2002-03-30T18:17:57.879Z2002-04-01T00:00:00.000Z010
C1_CP_FGM_SPIN2002-04-01T00:00:00.000Z2002-04-01T00:21:04.972Z010
C1_CP_FGM_SPIN2002-04-01T00:21:04.972Z2002-04-01T00:28:51.002Z11710
C1_CP_FGM_SPIN2002-04-01T00:28:51.002Z2002-04-01T00:35:16.683Z010
C1_CP_FGM_SPIN2002-04-01T00:35:16.683Z2002-04-01T03:36:48.128Z270410
C1_CP_FGM_SPIN2002-04-01T03:36:48.128Z2002-04-01T18:41:24.702Z010
C1_CP_FGM_SPIN2002-04-01T18:41:24.702Z2002-04-01T18:48:50.646Z11210
C1_CP_FGM_SPIN2002-04-01T18:48:50.646Z2002-04-01T18:55:20.346Z010
C1_CP_FGM_SPIN2002-04-01T18:55:20.346Z2002-04-02T06:44:49.979Z1053410
C1_CP_FGM_SPIN2002-04-02T06:44:49.979Z2002-04-02T18:46:30.878Z010
...............
C1_CP_FGM_SPIN2002-04-27T19:27:13.610Z2002-04-28T10:24:42.163Z1334010
C1_CP_FGM_SPIN2002-04-28T10:24:42.163Z2002-04-29T17:31:02.683Z010
C1_CP_FGM_SPIN2002-04-29T17:31:02.683Z2002-04-29T17:38:48.799Z11710
C1_CP_FGM_SPIN2002-04-29T17:38:48.799Z2002-04-29T17:45:18.569Z010
C1_CP_FGM_SPIN2002-04-29T17:45:18.569Z2002-04-29T22:14:47.992Z401510
C1_CP_FGM_SPIN2002-04-29T22:14:47.992Z2002-04-30T03:56:13.060Z010
C1_CP_FGM_SPIN2002-04-30T03:56:13.060Z2002-04-30T04:03:39.086Z11210
C1_CP_FGM_SPIN2002-04-30T04:03:39.086Z2002-04-30T04:10:04.839Z010
C1_CP_FGM_SPIN2002-04-30T04:10:04.839Z2002-04-30T22:19:33.785Z1625210
C1_CP_FGM_SPIN2002-04-30T22:19:33.785Z2002-05-01T00:00:00.000Z010
" ], "text/plain": [ "\n", " dataset_id start_time ... num_instances inventory_version\n", " object object ... int32 int32 \n", "-------------- ------------------------ ... ------------- -----------------\n", "C1_CP_FGM_SPIN 2002-03-30T18:17:57.879Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-01T00:00:00.000Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-01T00:21:04.972Z ... 117 10\n", "C1_CP_FGM_SPIN 2002-04-01T00:28:51.002Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-01T00:35:16.683Z ... 2704 10\n", "C1_CP_FGM_SPIN 2002-04-01T03:36:48.128Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-01T18:41:24.702Z ... 112 10\n", "C1_CP_FGM_SPIN 2002-04-01T18:48:50.646Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-01T18:55:20.346Z ... 10534 10\n", "C1_CP_FGM_SPIN 2002-04-02T06:44:49.979Z ... 0 10\n", " ... ... ... ... ...\n", "C1_CP_FGM_SPIN 2002-04-27T19:27:13.610Z ... 13340 10\n", "C1_CP_FGM_SPIN 2002-04-28T10:24:42.163Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-29T17:31:02.683Z ... 117 10\n", "C1_CP_FGM_SPIN 2002-04-29T17:38:48.799Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-29T17:45:18.569Z ... 4015 10\n", "C1_CP_FGM_SPIN 2002-04-29T22:14:47.992Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-30T03:56:13.060Z ... 112 10\n", "C1_CP_FGM_SPIN 2002-04-30T04:03:39.086Z ... 0 10\n", "C1_CP_FGM_SPIN 2002-04-30T04:10:04.839Z ... 16252 10\n", "C1_CP_FGM_SPIN 2002-04-30T22:19:33.785Z ... 0 10" ] }, "execution_count": 4, "metadata": {}, "output_type": "execute_result" } ], "source": [ "results = CSA.launch_job(\"SELECT dataset_id,start_time,end_time,num_instances,inventory_version \"\n", " \"FROM csa.v_dataset_inventory \"\n", " \"WHERE dataset_id='C1_CP_FGM_SPIN' \"\n", " \"AND start_time<='2002-05-01T00:00:00' \" \n", " \"AND end_time>='2002-04-01T00:00:00' \"\n", " \"ORDER BY start_time\")\n", "\n", "# Either print the results as text, or as an astropy.table (which can be easier to read)\n", "#print(results.get_results())\n", "\n", "r = results.get_results()\n", "r" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.8" }, "toc": { "base_numbering": 1, "nav_menu": {}, "number_sections": true, "sideBar": true, "skip_h1_title": true, "title_cell": "Table of Contents", "title_sidebar": "Contents", "toc_cell": false, "toc_position": {}, "toc_section_display": true, "toc_window_display": false } }, "nbformat": 4, "nbformat_minor": 4 }