<a id="recipes-bock20jgr"></a>

# Quantifying progress across different CMIP phases

## Overview

The recipe recipe_bock20jgr.yml generates figures to quantify the progress across
different CMIP phases.

#### NOTE
The current recipe uses a horizontal 5x5 grid for figure 10, while the
original plot in the paper shows a 2x2 grid. This is solely done for
computational reasons (running the recipe with a 2x2 grid for figure 10
takes considerably more time than running it with a 5x5 grid) and can be
easily changed in the preprocessor section of the recipe if necessary.

## Available recipes and diagnostics

Recipes are stored in recipes/bock20jgr

> * recipe_bock20jgr_fig_1-4.yml
> * recipe_bock20jgr_fig_6-7.yml
> * recipe_bock20jgr_fig_8-10.yml

Diagnostics are stored in diag_scripts/

> Fig. 1:

> * bock20jgr/tsline.ncl: timeseries of global mean surface temperature
>   anomalies

> Fig. 2:

> * bock20jgr/tsline_collect.ncl: collect different timeseries from
>   tsline.ncl to compare different models ensembles

> Fig. 3 and 4:

> * bock20jgr/model_bias.ncl: global maps of the multi-model mean and the
>   multi-model mean bias

> Fig. 6:

> * perfmetrics/main.ncl
> * perfmetrics/collect.ncl

> Fig. 7:

> * bock20jgr/corr_pattern.ncl: calculate pattern correlation
> * bock20jgr/corr_pattern_collect.ncl: create pattern correlation plot

> Fig. 8:

> * climate_metrics/ecs.py
> * climate_metrics/create_barplot.py

> Fig. 9:

> * clouds/clouds_ipcc.ncl

> Fig. 10:

> * climate_metrics/feedback_parameters.py

## User settings in recipe

1. Script tsline.ncl

   *Required settings (scripts)*
   * styleset: as in diag_scripts/shared/plot/style.ncl functions

   *Optional settings (scripts)*
   * time_avg: type of time average (currently only “yearly” and “monthly” are
     available).
   * ts_anomaly: calculates anomalies with respect to the defined reference
     period; for each grid point by removing the mean for the given
     calendar month (requiring at least 50% of the data to be
     non-missing)
   * ref_start: start year of reference period for anomalies
   * ref_end: end year of reference period for anomalies
   * ref_value: if true, right panel with mean values is attached
   * ref_mask: if true, model fields will be masked by reference fields
   * region: name of domain
   * plot_units: variable unit for plotting
   * y_min: set min of y-axis
   * y_max: set max of y-axis
   * mean_nh_sh: if true, calculate first NH and SH mean
   * volcanoes: if true, lines of main volcanic eruptions will be added
   * header: if true, use region name as header
   * write_stat: if true, write multi-model statistics to nc-file

   *Required settings (variables)*

   none
   * Optional settings (variables)

   none
2. Script tsline_collect.ncl

   *Required settings (scripts)*
   * styleset: as in diag_scripts/shared/plot/style.ncl functions

   *Optional settings (scripts)*
   * time_avg: type of time average (currently only “yearly” and “monthly” are
     available).
   * ts_anomaly: calculates anomalies with respect to the defined period
   * ref_start: start year of reference period for anomalies
   * ref_end: end year of reference period for anomalies
   * region: name of domain
   * plot_units: variable unit for plotting
   * y_min: set min of y-axis
   * y_max: set max of y-axis
   * order: order in which experiments should be plotted
   * header: if true, region name as header
   * stat_shading: if true: shading of statistic range
   * ref_shading: if true: shading of reference period

   *Required settings (variables)*

   none
   * Optional settings (variables)

   none
3. Script model_bias.ncl

   *Required settings (scripts)*

   none

   *Optional settings (scripts)*
   * projection: map projection, e.g., Mollweide, Mercator
   * timemean: time averaging, i.e. “seasonalclim” (DJF, MAM, JJA, SON),
     “annualclim” (annual mean)
   * Required settings (variables)\*
   * reference_dataset: name of reference dataset

   *Optional settings (variables)*
   * long_name: description of variable

   *Color tables*
   * variable “tas”: diag_scripts/shared/plot/rgb/ipcc-ar6_temperature_div.rgb,
   * variable “pr-mmday”: diag_scripts/shared/plots/rgb/ipcc-ar6_precipitation_seq.rgb
     diag_scripts/shared/plot/rgb/ipcc-ar6_precipitation_div.rgb
4. Script perfmetrics_main.ncl

   See [here](recipe_perfmetrics.html.md#perf-main-ncl).
5. Script perfmetrics_collect.ncl

   See [here](recipe_perfmetrics.html.md#perf-collect-ncl).
6. Script corr_pattern.ncl

   *Required settings (scripts)*

   none

   *Optional settings (scripts)*
   * plot_median

   *Required settings (variables)*
   * reference_dataset

   *Optional settings (variables)*
   * alternative_dataset
7. Script corr_pattern_collect.ncl

   *Required settings (scripts)*

   none

   *Optional settings (scripts)*
   * diag_order

   *Color tables*
   * diag_scripts/shared/plot/rgb/ipcc-ar6_line_03.rgb
8. Script ecs.py

   See [here](recipe_ecs.html.md#ecs-py).
9. Script create_barplot.py

   See [here](recipe_ecs.html.md#create-barplot-py).
10. Script clouds_ipcc.ncl

    See [here](recipe_clouds.html.md#clouds-ipcc-ncl).
11. Script feedback_parameters.py

    *Required settings (scripts)*

    none

    *Optional settings (scripts)*
    * calculate_mmm: *bool* (default: `True`). Calculate multi-model means.
    * only_consider_mmm: *bool* (default: `False`). Only consider multi-model
      mean dataset. This automatically sets `calculate_mmm` to `True`. For
      large multi-dimensional datasets, this might significantly reduce the
      computation time if only the multi-model mean dataset is relevant.
    * output_attributes: *dict*. Write additional attributes to netcdf files.
    * seaborn_settings: *dict*. Options for [`seaborn.set_theme()`](https://seaborn.pydata.org/generated/seaborn.set_theme.html#seaborn.set_theme) (affects
      all plots).

## Variables

* clt (atmos, monthly, longitude latitude time)
* hus (atmos, monthly, longitude latitude lev time)
* pr (atmos, monthly, longitude latitude time)
* psl (atmos, monthly, longitude latitude time)
* rlut (atmos, monthly, longitude latitude time)
* rsdt (atmos, monthly, longitude latitude time)
* rsut (atmos, monthly, longitude latitude time)
* rtmt (atmos, monthly, longitude latitude time)
* rlutcs (atmos, monthly, longitude latitude time)
* rsutcs (atmos, monthly, longitude latitude time)
* ta (atmos, monthly, longitude latitude lev time)
* tas (atmos, monthly, longitude latitude time)
* ts (atmos, monthly, longitude latitude time)
* ua (atmos, monthly, longitude latitude lev time)
* va (atmos, monthly, longitude latitude lev time)
* zg (atmos, monthly, longitude latitude time)

## Observations and reformat scripts

* AIRS (obs4MIPs) - specific humidity
* CERES-EBAF (obs4MIPs) - CERES TOA radiation fluxes (used for calculation of
  cloud forcing)
* ERA-Interim - reanalysis of surface temperature, sea surface pressure

  *Reformat script:* recipes/cmorizers/recipe_era5.yml
* ERA5 - reanalysis of surface temperature

  *Reformat script:* recipes/cmorizers/recipe_era5.yml
* ESACCI-CLOUD - total cloud cover

  *Reformat script:* cmorizers/data/formatters/datasets/esacci_cloud.ncl
* ESACCI-SST - sea surface temperature

  *Reformat script:* cmorizers/data/formatters/datasets/esacci_sst.py
* GHCN - Global Historical Climatology Network-Monthly gridded land precipitation

  *Reformat script:* cmorizers/data/formatters/datasets/ghcn.ncl
* GPCP-SG (obs4MIPs) - Global Precipitation Climatology Project total
  precipitation
* HadCRUT4 - surface temperature anomalies

  *Reformat script:* cmorizers/data/formatters/datasets/hadcrut4.ncl
* HadISST - surface temperature

  *Reformat script:* cmorizers/data/formatters/datasets/hadisst.ncl
* JRA-55 (ana4MIPs) - reanalysis of sea surface pressure
* NCEP-NCAR-R1 - reanalysis of surface temperature

  *Reformat script:* cmorizers/data/formatters/datasets/ncep_ncar_r1.py
* PATMOS-x - total cloud cover

  *Reformat script:* cmorizers/data/formatters/datasets/patmos_x.ncl

## References

* Bock, L., Lauer, A., Schlund, M., Barreiro, M., Bellouin, N., Jones, C.,
  Predoi, V., Meehl, G., Roberts, M., and Eyring, V.: Quantifying progress
  across different CMIP phases with the ESMValTool, Journal of Geophysical
  Research: Atmospheres, 125, e2019JD032321. [https://doi.org/10.1029/2019JD032321](https://doi.org/10.1029/2019JD032321)
* Copernicus Climate Change Service (C3S), 2017: ERA5: Fifth generation of
  ECMWF atmospheric reanalyses of the global climate, edited, Copernicus
  Climate Change Service Climate Data Store (CDS).
  [https://doi.org/10.24381/cds.143582cf](https://doi.org/10.24381/cds.143582cf)
* Flato, G., J. Marotzke, B. Abiodun, P. Braconnot, S.C. Chou, W. Collins, P.
  Cox, F. Driouech, S. Emori, V. Eyring, C. Forest, P. Gleckler, E. Guilyardi,
  C. Jakob, V. Kattsov, C. Reason and M. Rummukainen, 2013: Evaluation of
  Climate Models. In: Climate Change 2013: The Physical Science Basis.
  Contribution of Working Group I to the Fifth Assessment Report of the
  Intergovernmental Panel on Climate Change [Stocker, T.F., D. Qin, G.-K.
  Plattner, M. Tignor, S.K. Allen, J. Boschung, A. Nauels, Y. Xia, V. Bex and
  P.M. Midgley (eds.)]. Cambridge University Press, Cambridge, United Kingdom
  and New York, NY, USA.
* Morice, C. P., Kennedy, J. J., Rayner, N. A., & Jones, P., 2012: Quantifying
  uncertainties in global and regional temperature change using an ensemble of
  observational estimates: The HadCRUT4 data set, Journal of Geophysical
  Research, 117, D08101. [https://doi.org/10.1029/2011JD017187](https://doi.org/10.1029/2011JD017187)

## Example plots

<a id="fig-bock20jgr-1"></a>
![image](recipes/figures/bock20jgr/tas_Global_CMIP6_historical_anom_1850-2014.png)

<a id="fig-bock20jgr-2"></a>
![image](recipes/figures/bock20jgr/tas_Global_multimodel_anom_1850-2017.png)

<a id="fig-bock20jgr-3"></a>
![image](recipes/figures/bock20jgr/model_bias_tas_annual_CMIP6.png)

<a id="fig-bock20jgr-4"></a>
![image](recipes/figures/bock20jgr/ta850-global_to_swcre-global_RMSD.png)

<a id="fig-bock20jgr-5"></a>
![image](recipes/figures/bock20jgr/patterncor.png)
