The project is led by Solvership, with partners Velebit and the University of Zagreb, Faculty of Organization and Informatics. It is co-financed by the European Regional Development Fund, with a total project value of €3,138,229, of which FOI’s share amounts to €420,052.
Project objective
The aim of the project is to develop a modular platform for continuous real-time monitoring of AI models. AI models are often considered “black boxes” due to their complexity, meaning they are typically non-interpretable and do not provide insight into their decision-making processes. At the same time, increasingly strict regulatory requirements (EU AI Act, GDPR, CSRD) are creating a gap between technological development and compliance.
This opens space for a comprehensive solution that enables simultaneous monitoring of ethics and privacy, empowering organizations in regulated sectors such as finance, healthcare, and telecommunications to use AI responsibly and transparently. The system will enable detection of discriminatory decision-making based on attributes such as gender, age, or location, provide explanations of AI-driven decisions, and quantify the impact of personal data in real time.
Project team
The FOI project team consists of Prof. Jasminka Dobša, PhD as project leader, together with Prof. Danijel Radošević, PhD, Prof. Sandra Lovrenčić, PhD, Prof. Ivan Magdalenić, PhD, Prof. Renata Mekovec, PhD, and Maja Buhin Pandur, prof. math.
FOI’s role in the project includes methodological oversight, defining fairness and compliance metrics tailored to the platform under development, as well as scientific validation and dissemination of project results.
