PhD stipend in Digital Twins and Hierarchical Multi-Agent Safe Reinforcement Learning.(DEIS)

Offer Description The Department of Computer Science at The Technical Faculty of IT and Design invites applications for PhD stipends on one of the topics of Digital Twins and Hierarchical Multi-Agent Safe Reinforcement Learning . The stipends are open for appointment from January 1, 2026, or shortly thereafter. The duration of the position is three years. The stipend is within the DEIS group and supervised by Professor Kim Guldstrand Larsen . Within DEIS the group has developed the award‑winning tool UPPAAL ( supporting modeling, validation, performance evaluation, synthesis and learning of controllers for real‑time and cyber‑physical systems. The tool has been applied to learning controllers in domains ranging from traffic control, water management to energy‑aware buildings. Your work tasks The stipend will address challenges related to sustainable water‑based cooling in megacities. Research questions include “how can digital twins of buildings a number of specified properties (temperature, cooling load demand, energy consumption, potential leaks, etc.) be used for online monitoring such that warnings will be made as soon as the probability of given threshold values is exceeded and becomes critically high” and “how can the digital twins be used to provide online predictions of the future expected evolution of these critical properties as the basis for safe reinforcement learning (RL) for online optimal control”. In particular, the stipend will investigate enhancement of RL controllers in multi‑agent settings and by incorporating optimization techniques such as multi‑objective optimization. Overall, the stipend will contribute to overall optimization minimizing CO₂ emissions and overall cost. We are looking for a team member who can immediately contribute to the two specific topics. Applicants should have a background (MSc and BSc degrees) in Computer Science, Software Engineering or Control Theory and a demonstrated ability to work independently as well as in a team. Mastery of adequate modelling tools and programming languages e.g. UPPAAL, MATLAB, MODELICA, C++, Python, and machine learning is necessary as well as excellent communication skills in English. Applicants with experience in digital energy and, if possible, co‑simulation frameworks such as FMI/FMU will be preferred. Qualification requirements PhD stipends are allocated to individuals who hold a Master’s degree. PhD stipends are normally for a period of 3 years. It is a prerequisite for allocation of the stipend that the candidate will be enrolled as a PhD student at the Technical Doctoral School of IT and Design in accordance with the regulations of Ministerial Order No. 1124 of September 19, 2025 on the PhD Programme at the Universities and Certain Higher Artistic Educational Institutions. According to the Ministerial Order, the progress of the PhD student shall be assessed at regular points in time. Who we are According to the most recent US News and World Ranking, Aalborg University ranks 3rd in Europe and 27th in the world within Best Universities for Engineering. According to a 2018 MIT report, Aalborg University is considered to have the 4th best engineering program in the world. According to the recent Times Higher Education Impact ranking, Aalborg University ranks 9th in the World for UN SDG Impact. Department of Computer Science at Aalborg University is highly regarded among researchers, students and external partners because of our leading research, education, and collaboration. The department currently has more than 170 scientific staff, 20 administrative staff and 1,100 students, which are based on AAU’s problem‑based learning model. You can read more on and you can read more about the TECH faculty here. The Distributed, Embedded and Intelligent Systems (DEIS) group at Aalborg University, led by Professor Kim G. Larsen, is worldwide renowned for advancing formal methods and the UPPAAL tool suite for modeling, verification, and synthesis of cyber‑physical systems. Combining strong theoretical foundations with industrial collaboration, DEIS applies UPPAAL‑based techniques to real‑world domains such as energy, water, and intelligent infrastructure, ensuring trustworthy, efficient, and sustainable system operation. How to apply Your application must include the following: Application, stating reasons for applying and qualifications in relation to the position. Diplomas (bachelor and master’s degree diplomas). Project description: Applicants are required to submit, along with their application documents, a one‑page statement indicating their vision for research to be conducted in relation to the project topics outlined above. Other relevant documents. The application must be submitted via Aalborg University’s recruitment system, which can be accessed under the job advertisement on Aalborg University’s website. Do you have any questions? If you have any questions about the position, you are more than welcome to contact us. You will find contact persons at the bottom of the job post. Further information We recommend that you save a copy of the job posting, as it will be removed once the application deadline has passed. Read more about our recruitment process here. The assessment of candidates for the position will be carried out by qualified experts. Shortlisting will be applied. After the application deadline, the head of the department, with the assistance of the hiring committee, will select the applicants to be assessed. All applicants will be informed whether they have been shortlisted for assessment or not. The hiring process at Aalborg University may include a risk assessment as a tool to identify potential risks associated with new hires, ensuring the safety, compliance, and integrity of the workplace. #J-18808-Ljbffr