Streamed Data - CSA Guide
STREAMed DATA REQUESTS
Data streaming allows a faster delivery of the data. It enables immediate streaming of one dataset to the user's machine (instead of a file package being created on the CSA server and then sent). However, the following constraints apply:
-
Only CEF products can be downloaded using these requests
-
Only one dataset can be requested
-
Only one file is delivered for the time period requested, i.e. delivery interval option is not available
-
Header only cannot be requested
-
If the internet connection is broken before file download has completed, the request must be made again to retrieve the whole file
Note that authentication is not required.
The details of the request need to be built on the following base:
https://csa.esac.esa.int/csa-sl-tap/data?RETRIEVAL_TYPE=product&RETRIEVAL_ACCESS=streamed&
Then add the DATASET_ID, START_DATE and END_DATE details, which are also mandatory:
PARAMETER NAME(S) |
DESCRIPTION |
MANDATORY? |
POSSIBLE VALUES |
RETRIEVAL_TYPE |
Type of retrieval. PRODUCT (Cluster data file) or HEADER |
YES |
PRODUCT or HEADER |
RETRIEVAL_ACCESS |
Type of retrieval access = STREAMED in this case |
YES |
STREAMED |
DATASET_ID |
Unique identifier of the dataset whose data we want to retrieve. |
YES |
Any of the Cluster datasets. |
START_DATE |
Start time of the time range that the retrieved files should cover. |
YES |
ISO time format: 'yyyy-MM-ddTHH:mm:ssZ' |
END_DATE |
End time of the time range that the retrieved files should cover. |
YES |
ISO time format: 'yyyy-MM-ddTHH:mm:ssZ' |
Unlike the direct and asynchronous requests, the request will be rejected if the start_date and end_date aren't included.
The only optional parameter is:
PARAMETER NAME(S) |
DESCRIPTION |
MANDATORY? |
POSSIBLE VALUES |
GZIP |
Specifies if the retrieved file is gzip compressed or not. By default, "0" |
NO |
0 or 1 |
STREAMed USE CASES
Streamed UC1 - SIMPLE REQUEST
Request DWP caveats for time range '2007-01-15 18:00:00 / 2007-01-16 00:00:00'.
https://csa.esac.esa.int/csa-sl-tap/data?RETRIEVAL_TYPE=product&RETRIEVAL_ACCESS=streamed&DATASET_ID=C3_CQ_DWP_INST&START_DATE=2007-01-15T18:00:00Z&END_DATE=2007-01-16T00:00:00Z
Streamed UC2 - COMPRESSED
Request PEACE products for more than one month in compressed format:
https://csa.esac.esa.int/csa-sl-tap/data?RETRIEVAL_TYPE=product&RETRIEVAL_ACCESS=streamed&DATASET_ID=C4_CP_PEA_LERL_PSD&START_DATE=2004-09-18T10:00:00Z&END_DATE=2004-10-20T22:00:00Z&GZIP=1