AI Policy#

“AI” herein refers to generative AI tools like large language models (LLMs) that can generate, edit, and review software code, create and manipulate images, or generate human-like communication.

Responsibility#

You are responsible for any code you submit to ESMValTool’s repositories, regardless of whether it was manually written or generated by AI. You must understand and be able to explain the code you submit as well as the existing related code. It is not acceptable to submit a patch that you cannot understand and explain yourself. In explaining your contribution, do not use AI to automatically generate comments, pull request descriptions, or issue descriptions. Refer to Coding with AI: Opportunities and Responsibilities for Researchers for an introduction to using AI in research and software development.

Disclosure#

You must disclose whether AI has been used to assist in the development of your pull request. If so, you must document which tool(s) have been used, how they were used, and specify what code or text is partially or fully AI generated. We will politely reject any pull request that does not include the disclosure.

Code Quality#

Contributors are expected to submit code that meets ESMValTool’s standards. We will politely reject pull requests that we deem to be “AI generated and of little substantive value”. Do not waste developers’ time by submitting code that is fully or mostly generated by AI, and doesn’t meet our standards. In particular, AI tools tend to produce lengthy, verbose code and documentation. Please edit it down so it is concise and easy for humans to read and review.

Communication#

When interacting with developers (forums, discussions, issues, pull requests, etc.) do not use AI to speak for you, except for translation or grammar editing. Human-to-human communication is essential for an open source community to thrive.

If you suspect that a contributor has used AI in a way that violates this policy, please point them to this document and politely ask them to update their contribution accordingly.

AI Agents#

The use of an AI agent that writes code and then submits a pull request autonomously is not permitted. A human must check any generated code and submit a pull request according to the ‘Responsibility’ section above.

AI for research#

Refer to Coding with AI: Opportunities and Responsibilities for Researchers for an introduction to using AI in research and software development. When using AI to assist with research, be aware that some AI tools train on your input and may use it to generate content for others. This is especially true for free AI services and often the default setting for paid services. Never use such tools with private repositories that may contain unpublished research, as you may inadvertently leak (other people’s) private code, documentation, and results to competing researchers or the general public.

Other Resources#

While these do not formally form part of ESMValTool’s AI policy, the following resources may be helpful in understanding some pitfalls associated with using AI to contribute to ESMValTool:

Acknowledgements#

We thank the NumPy developers for their AI policy, upon which this document is largely based.