Study how to enable AI systems to understand human trust development during human-AI collaboration through multi-modal modeling, allowing for improved trust calibration.
Job description
Hybrid Intelligence (HI) is the combination of human and artificial intelligence (AI), augmenting human intellect instead of replacing it, and developing AI which works with and for humans.
Hybrid Intelligent AI systems should actively calibrate the trust they elicit from humans they interact with by actively identifying cases of over/under-trust, and then acting to address these. To do this, they require an understanding of their human partners' trust perceptions and how these dynamically evolve. Currently, trust perceptions are typically measured using explicit assessments, such as questionnaires at static moment in time. However, such measures lack efficiency in providing feedback for trust calibration in human-AI interactions, and effectiveness because they struggle to capture fine-grained information about how human trust perceptions dynamically evolve.
In this project, you will be working to address this issue by developing approaches using multimodal sensor data for the implicit assessment of human trust perceptions. In particular, you will work on answering the following research question: How can we enable artificial intelligence systems to efficiently and effectively assess the dynamic development of humans' trust evaluations during collaboration for improved calibration behavior?
Given the recent advances in multimodal language modeling (e.g., MLLMs), this project will explore approaches that leverage unstructured language data describing elements of human trust perceptions and associated reasoning processes during interactions captured with a "Think Aloud" (TA) protocol. The project will involve collecting multimodal data about trust behavior; identifying data collection approaches for effective and efficient modeling of trust perceptions and calibration; and addressing a cycle of trust behavior, from understanding human trust, to adjusting agent behavior, which in turn influences human trust.
This project will be supervised by dr. Bernd Dudzik and dr. Myrthe Tielman. That means the candidate will be a part of both the research group of Pattern Recognition and Interactive Intelligence, both within the Intelligent Systems section of Computer Science, EEMCS. Additional co-supervisors will be Prof. Dr. Mark Neerincx (II, TU Delft & TNO) and Prof. Dr. Dan Balliet (VU Amsterdam).
This project is part of a larger research effort within the Hybrid Intelligence Center, where you will have the opportunity to collaborate with researchers across multiple universities and disciplines.
Job requirements
We are looking for a candidate who meets the following essential criteria:
- A Master's degree or equivalent (or about to graduate with one) in a relevant field (Artificial Intelligence, Computer Science, Data Science, Cognitive Science, etc.)
- A good command of spoken & written English
- A curiosity-driven mindset and a willingness to learn
- Some experience with ML or NLP
- Some experience in collecting multimodal datasets or running experiments with human subjects
We encourage you to apply even if you do not meet all the criteria above as long as you are willing to acquire the relevant skills.
Additionally, the following criteria are appreciated:
- Experience with interdisciplinary research projects.
- Strong analytical and conceptual modelling competencies
- Good programming skills (preferably Python), including ML methods and libraries.
TU Delft (Delft University of Technology)
Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.
At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.
Challenge. Change. Impact!
Faculty Electrical Engineering, Mathematics and Computer Science
The Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS) brings together three scientific disciplines. Combined, they reinforce each other and are the driving force behind the technology we all use in our daily lives. Technology such as the electricity grid, which our faculty is helping to make completely sustainable and future-proof. At the same time, we are developing the chips and sensors of the future, whilst also setting the foundations for the software technologies to run on this new generation of equipment - which of course includes AI. Meanwhile we are pushing the limits of applied mathematics, for example mapping out disease processes using single cell data, and using mathematics to simulate gigantic ash plumes after a volcanic eruption. In other words: there is plenty of room at the faculty for ground-breaking research. We educate innovative engineers and have excellent labs and facilities that underline our strong international position. In total, more than 1000 employees and 4,000 students work and study in this innovative environment.
to go to the website of the Faculty of Electrical Engineering, Mathematics and Computer Science.
Conditions of employment
Doctoral candidates will be offered a 4-year period of employment in principle, but in the form of 2 employment contracts. An initial 1,5 year contract with an official go/no go progress assessment within 15 months. Followed by an additional contract for the remaining 2,5 years assuming everything goes well and performance requirements are met.
Salary and benefits are in accordance with the Collective Labour Agreement for Dutch Universities, increasing from € 2901 per month in the first year to € 3707 in the fourth year. As a PhD candidate you will be enrolled in the TU Delft Graduate School. The TU Delft Graduate School provides an inspiring research environment with an excellent team of supervisors, academic staff and a mentor. The Doctoral Education Programme is aimed at developing your transferable, discipline-related and research skills.
The TU Delft offers a customisable compensation package, discounts on health insurance, and a monthly work costs contribution. Flexible work schedules can be arranged.
is available, to support your accompanying partner with their job search in the Netherlands.