Output Format
Data organization
The data are organized in a gridded data structure, i.e. data cubes. The tiles manifest as directories in the file system, and the images are stored within. For mosaicking, use force-mosaic.
See also
Check out this tutorial, which explains what a datacube is, how it is parameterized, how you can find a POI, how to visualize the tiling grid, and how to conveniently display cubed data.
Data Cube definition
The spatial data cube definition is appended to each data cube, i.e. to each directory containing tiled datasets, see Data Cube definition.
Naming convention
Following 41-digit naming convention is applied to all output files:
Example filename: 2000-2010_001-365-03_HL_CSO_LNDLG_NUM.tif
There are several product types available, all are optional.
The Number of Observations (NUM
) product contains the number of clear sky observations for each pixel and bin.
The other products are statistical summaries of the temporal difference (dt) between consecutive observations within these bins.
Table 1: Naming convention
Digits |
Description |
|
---|---|---|
1–9 |
Temporal range for the years as YYYY–YYYY |
|
11-17 |
Temporal range for the DOY as DDD–DDD |
|
19-20 |
Temporal binning in months |
|
22-23 |
Product Level |
|
25-27 |
Submodule |
|
29-33 |
Sensor ID |
|
LNDLG |
Landsat legacy bands |
|
SEN2L |
Sentinel-2 land bands |
|
SEN2H |
Sentinel-2 high-res bands |
|
R-G-B |
Visible bands |
|
VVVHP |
VV/VH Dual Polarized |
|
35-37 |
Product Type |
|
NUM |
Number of Observations |
|
AVG |
Average of days between observations (dt) |
|
STD |
Standard Deviation of dt |
|
MIN |
Minimum of dt |
|
MAX |
Maximum of dt |
|
RNG |
Range of dt |
|
SKW |
Skewness of dt |
|
KRT |
Kurtosis of dt |
|
QXX |
Quantile of dt (e.g. 0.25 quantile = Q25) |
|
IQR |
Interquartile Range of dt |
|
39-41 |
File extension |
|
tif |
image data in compressed GeoTiff format |
|
dat |
image data in flat binary ENVI format |
|
hdr |
metadata for ENVI format |
|
File format
The images are provided with signed 16bit datatype and band sequential (BSQ) interleaving in one of the following formats:
GeoTiff
This is the recommended output option. Images are compressed GeoTiff images using LZW compression with horizontal differencing. The images are generated with internal blocks for partial image access. These blocks are strips that are as wide as the
TILE_SIZE
and as high as theBLOCK_SIZE
.ENVI Standard format
This produces flat binary images without any compression. This option might seem tempting as there is no overhead in cracking the compression when reading these data. However, the transfer of the larger data volume from disc to CPU often takes longer than cracking the compression. Therefore, we recommend to use the GeoTiff option.
Metadata
Metadata are written to all output products.
For ENVI format, the metadata are written to the ENVI header (.hdr
extension).
For GeoTiff format, the metadata are written into the GeoTiff file.
If the metadata is larger than allowed by the GeoTiff driver, the excess metadata will be written to an “auxiliary metadata” file with .aux.xml
extension.
FORCE-specific metadata will be written to the FORCE domain, and thus are probably not visible unless the FORCE domain (or all domains) are specifically printed:
gdalinfo -mdd all 20160823_LEVEL2_SEN2A_BOA.tif
Product type
Clear Sky Observation Statistcs
Currently available statistics are the number of observations, and aggregate statistics of the temporal difference between observations (available are average, standard deviation, minimum, maximum, range, skewness, kurtosis, any quantile from 1-99%, and interquartile range.