More Transparency in Artificial Intelligence

Here’s the press release of TU Braunschweig:

In the last decades, new technologies have made it possible to develop a wide variety of systems that can generate huge amounts of biomedical data, for example in cancer research. At the same time, completely new possibilities have developed for examining and evaluating this data using artificial intelligence methods. AI algorithms in intensive care units, e.g., can predict circulatory failure at an early stage based on large amounts of data from several monitoring systems, by processing a lot of complex information from different sources at the same time, which is far beyond human capabilities.

This great potential of AI systems leads to an unmanageable number of biomedical AI applications. Unfortunately, the corresponding reports and publications do not always adhere to best practices or provide only incomplete information about the algorithms used or the origin of the data. This makes assessment and comprehensive comparisons of AI models difficult. The decisions of AIs are not always comprehensible to humans and results are seldomly fully reproducible. This situation is untenable, especially in clinical research, where trust in AI models and transparent research reports are crucial to increase the acceptance of AI algorithms and to develop improved AI methods for basic biomedical research.

To address this problem, an international research team including the division Data Science in Biomedicine of Peter L. Reichertz Institute for Medical Informatics (PLRI) has proposed the AIMe registry for artificial intelligence in biomedical research, a community-driven registry that enables users of new biomedical AI to create easily accessible, searchable and citable reports that can be studied and reviewed by the scientific community.

The freely accessible registry is available at aime-registry.org and consists of a user-friendly web service that guides users through the AIMe-standard and enables them to generate complete and standardised reports on the AI models used. A unique AIMe identifier is automatically created, which ensures that the report remains persistent and can be specified in publications. Hence, authors don’t have to cope with the time-consuming description of all facets of the AI used in articles for scientific journals and simply refer to the report in the AIMe registry.

Since the registry is designed as a web platform maintained by the scientific community, every user can ask questions about existing reports, make comments or suggest improvements. This feedback from the community will also be included in the annual update of the AIMe standard, and interested researchers can join the AIMe Steering Committee to become more involved in the further standardisation of biomedical AI.

“In the AIMe-registry, you can not only register novel AI methods in a citable manner. You can also search for existing methods for your specific application. There’s no need to reinvent the wheel and you can be sure that the AI is properly evaluated and adheres to the AIMe standard. AI developers and users alike will profit immensely from the AIMe-registry.” says Professor Tim Kacprowski, director of the division Data Science in Biomedicine of PLRI and member of BRICS – Braunschweig Integrated Centre of Systems Biology.