diff --git a/INSTRUCTIONS.md b/INSTRUCTIONS.md index 4730e9eb509051772a61ba26a11a7ede27ccec62..6b3d73555b7cb44415e449ffc2f488ad2e9c081c 100644 --- a/INSTRUCTIONS.md +++ b/INSTRUCTIONS.md @@ -10,9 +10,10 @@ Detailled instructions on how to create the AWI Basemap. The process described below is entirely based on open source GIS software. Most of the steps could also be done within the graphical user interface of QGIS. Others rely on commandline usage of the GDAL package (ogr2ogr) which comes with the QGIS installation. To run the scripts, you need the following: -- python 3.x -- gdal -- gdal-python +- [Python 3.x](https://www.python.org/) +- [GDAL](https://gdal.org/) +- [rasterio](https://rasterio.readthedocs.io/en/latest/index.html) +- [OSGeo](https://www.osgeo.org/) The scripts where designed for and tested with the OSGeo4W installation of the above mentioned packages. @@ -20,22 +21,22 @@ The scripts where designed for and tested with the OSGeo4W installation of the a Before processing and combining all input layers to the basemap, we need to download some geodata. -##### General Bathymetric Chart of the Oceans (GEBCO) +#### General Bathymetric Chart of the Oceans (GEBCO) GEBCO is the DEM basis for the basemap. Download GEBCO in its global netCDF version to avoid the GeoTIFF tiles. Details on the GEBCO dataset can be found [here](https://gitlab.awi.de/sdreutte/basemap/-/blob/master/data/gebco.md). Download GEBCO here: https://www.gebco.net/data_and_products/gridded_bathymetry_data/ The netCDF grid `GEBCO_2020.nc` should be placed in `~/data/gebco/`. -##### Global Land Ice Measurements from Space (GLIMS) +#### Global Land Ice Measurements from Space (GLIMS) To overlay the map with global glaciers, GLIMS stores the necessary data. Download the latest GLIMS dataset as ESRI Shapefile Polygon. Details on the GLIMS dataset can be found [here](https://gitlab.awi.de/sdreutte/basemap/-/blob/master/data/glims.md). Download GLIMS here: http://www.glims.org/download/latest The SHP file `glims_polygons.shp` (and all auxiliary files) should be placed in `~data/glims/`. -##### Greenland Ice Mapping Project (GIMP) +#### Greenland Ice Mapping Project (GIMP) To overlay the map with the Greenland ice sheet, GIMP stores the necessary data. Download the latest GIMP Ice Mask dataset as GeoTIFF. To access the GIMP dataset, a NASA Earthdata account is needed. Details on the GIMP dataset can be found [here](https://gitlab.awi.de/sdreutte/basemap/-/blob/master/data/gimp.md). Download GIMP here: https://nsidc.org/data/nsidc-0714/versions/1 The geoTIFF grid `GimpIceMask_90m_v1.1.tif` should be placed in `~data/gimp/`. -##### SCAR Antarctic Digital Database (ADD) +#### SCAR Antarctic Digital Database (ADD) To overlay the map with the Antarctic ice sheet and shelf ice, the ADD stores the necessary data. Download the coastline data and the rock outcrop data (medium resolution version is sufficient. Details on the ADD dataset can be found [here](https://gitlab.awi.de/sdreutte/basemap/-/blob/master/data/add.md). Download ADD coastlines and ADD rock outcrops here: https://data.bas.ac.uk/collections/e74543c0-4c4e-4b41-aa33-5bb2f67df389/ The GPKG files `add_coastline_medium_res_polygon_v***.gpkg` and `add_rock_outcrop_medium_res_polygon_v***.gpkg` should be placed in `~data/add/`. @@ -44,18 +45,21 @@ The GPKG files `add_coastline_medium_res_polygon_v***.gpkg` and `add_rock_outcro Most of the necessary adjustments are happening in `~/process/config.py`. There is one minor thing that might need adjustment in another script. -## 2.1 `~/process/config.py` +## 2.1 [`~/process/config.py`](https://gitlab.awi.de/sdreutte/basemap/-/blob/master/process/config.py) -##### Input Files +#### Metadata +Keep the Metadata section in the configuration updated (sources, etc.). + +#### Input Files After downloading the input data you need to make sure the input files in the configuration fit the filenames of the downloaded datasets. New versions of the datasets might lead to new filenames. Go through the `INPUT FILES` section in the configuration and check them all. -##### General Create Options +#### General Create Options The default settings for resolution (degree/meter), the z factor for shading and the extent of the polar grids are set here. If you want different settings, adjust the variables in this section. However, read the notes, expecially on resolution. -##### Operational Parameters +#### Operational Parameters Some scripts call the Python executable which is set in `config.py` with `sys.executable`. If you need a specific Python 3.x executable, adjust it here. -## 2.2 `~/process/1_process_add.py` +## 2.2 [`~/process/1_process_add.py`](https://gitlab.awi.de/sdreutte/basemap/-/blob/master/process/1_process_add.py) Some of the vector processes require the GPKG layer names in their SQL commands. In ADD there is an inconsistency with the layer bames, which is why the layer name varibale for rock outcrops needs to be overwritten at the beginning of the process. In case this gets fixed or other incositencies arise in newer versions, make sure these are taken care of here. diff --git a/README.md b/README.md index 3020aa7daae8b42abe9d029231010cb413e189d9..862d0f213f066730b4da224f3880f620dec86083 100644 --- a/README.md +++ b/README.md @@ -1,33 +1,29 @@ # Basemap -Utility to create the **AWI Basemap** for [maps.awi.de](maps.awi.de), [data.awi.de](data.awi.de) and [marine-data.de](marine-data.de). +Utility to create the **AWI Basemap** for [maps.awi.de](https://maps.awi.de), [data.awi.de](https://data.awi.de) and [marine-data.de](https://marine-data.de). ## Description -The above mentioned websites use a global basemap with a colored and shaded digital elevation model (DEM) as a background. This basemap is an RGB GeoTIFF created from various geodata sources that need to be analysed (hillshade, slope), converted (raster to vector, vector to raster calculation), combined, colored and rendered to RGB. To ease the update process (e.g. new GEBCO version or any ofther data sources updated) this git provides the tools to create and update the **AWI Basemap**, as well as scripts to automate the process. +The above mentioned ites use a global basemap with a colored and shaded digital elevation model (DEM) as a background. This basemap is an RGB GeoTIFF created from various geodata sources that need to be analysed (hillshade, slope), converted (raster to vector, vector to raster calculation), combined, colored and rendered to RGB. To ease the update process (e.g. new GEBCO version or any ofther data sources updated) this git provides the tools to create and update the **AWI Basemap**, as well as scripts to automate the process. -At this point, the **AWI Basemap**s is available in three color sets. All three are based on the AWI blues (RGB bright: 7/172/231, RGB dark: 0/62/110). Yet, the "default" color palette reduces these blues to half their saturation, the "bright" color palette uses the blues directly, and the "dark" color palette uses the blues with a quarter of their saturation. +At this point, the **AWI Basemap** is created in two color sets. Both are based on the AWI blues (light: 0/172/229, dark: 0/62/110). Yet, the colors are toned down in their saturation to create a more pleasing viewing experience. ## Instructions -`INSTRUCTIONS.md` holds the instructions on the usage of the scripts to create the AWI Basemaps. +[`INSTRUCTIONS.md`](https://gitlab.awi.de/sdreutte/basemap/-/blob/master/INSTRUCTIONS.md) holds the instructions on the usage of the scripts to create the AWI Basemaps. ## Data -In `data`, all the necessary data sources are listed. As data is not stored in this git, textfiles give information on where to download the data and in which format it needs to be available for the process. +In [`data`](https://gitlab.awi.de/sdreutte/basemap/-/tree/master/data), all the necessary data sources are listed. As data is not stored in this git, textfiles give information on where to download the data and in which format it needs to be available for the process. ## Preview -In `preview`, you can get a glimps on the final output. +In [`preview`](https://gitlab.awi.de/sdreutte/basemap/-/tree/master/preview), you can get a glimps on the final output. ## Process -In `process`, all the required scripts are stored. +In [`process`](https://gitlab.awi.de/sdreutte/basemap/-/tree/master/process), all the required scripts are stored. ## Styles -In `styles`, all the required color palettes and auxiliary QGIS layer style files (QML) are stored. - -## Sources - -References and citations for data sources are listed in `SOURCES.md`. +In [`styles`](https://gitlab.awi.de/sdreutte/basemap/-/tree/master/styles), all the required color palettes and auxiliary QGIS layer style files (QML) are stored. diff --git a/SOURCES.md b/SOURCES.md deleted file mode 100644 index 935be3f3cbe3b3fbe954ec888504d3ad534ef382..0000000000000000000000000000000000000000 --- a/SOURCES.md +++ /dev/null @@ -1,12 +0,0 @@ -**General Bathymetric Chart of the Oceans (GEBCO_2020)** -GEBCO Compilation Group (2020) GEBCO 2020 Grid (doi:10.5285/a29c5465-b138-234d-e053-6c86abc040b9) - -**Global Land Ice Measurements from Space (GLIMS version 20200630)** -GLIMS and NSIDC (2005, updated 2020): Global Land Ice Measurements from Space glacier database. Compiled and made available by the international GLIMS community and the National Snow and Ice Data Center, Boulder CO, U.S.A. DOI:10.7265/N5V98602 - -**Greenland Ice Mapping Project (GIMP version 1.1)** -Howat, I. 2017. MEaSUREs Greenland Ice Mapping Project (GIMP) Land Ice and Ocean Classification Mask, Version 1. [GimpIceMask_90m_v1.1]. Boulder, Colorado USA. NASA National Snow and Ice Data Center Distributed Active Archive Center. doi: https://doi.org/10.5067/B8X58MQBFUPA. [2020-11-19]. - -**SCAR Antarctic Digital Database (ADD v7.3 and v7.4)** -Gerrish, L., Fretwell, P., & Cooper, P. (2021). Medium resolution vector polylines of the Antarctic coastline (7.4) [Data set]. UK Polar Data Centre, Natural Environment Research Council, UK Research & Innovation. https://doi.org/10.5285/824b5350-763e-4933-bb76-09f5d24cb033 -Gerrish, L., Fretwell, P., & Cooper, P. (2020). Medium resolution vector polygons of Antarctic rock outcrop (7.3) [Data set]. UK Polar Data Centre, Natural Environment Research Council, UK Research & Innovation. https://doi.org/10.5285/077e1f04-7068-4327-a4f2-71d863f70064 diff --git a/styles/basemap_blue_colorbar.png b/styles/basemap_blue_colorbar.png new file mode 100644 index 0000000000000000000000000000000000000000..a5d2b9245d5a3c26cee22719ff5c6331dd955155 Binary files /dev/null and b/styles/basemap_blue_colorbar.png differ diff --git a/styles/basemap_grey_colorbar.png b/styles/basemap_grey_colorbar.png new file mode 100644 index 0000000000000000000000000000000000000000..9e5432df87b5ea195a721ee951a3f8dfcbf77b7a Binary files /dev/null and b/styles/basemap_grey_colorbar.png differ diff --git a/styles/basemap_greyblue_colorbar.png b/styles/basemap_greyblue_colorbar.png new file mode 100644 index 0000000000000000000000000000000000000000..e3a44dd7eb0aa98bca35c1598e39d78aa35fb3f9 Binary files /dev/null and b/styles/basemap_greyblue_colorbar.png differ