Darmstadt: Student Assistant in the Field of LLM Security

The Fraunhofer Institute for Secure Information Technology SIT is one of the leading research and development institutions for cybersecurity in Germany and Europe and is part of ATHENE, the national research center for applied cybersecurity. ATHENE is a cooperation between the Fraunhofer Society, TU Darmstadt, Darmstadt University of Applied Sciences, and Goethe University Frankfurt. Our common goal: to make the world of tomorrow safer.

Be part of change

• Development of methods to enhance the security of LLMs. A major focus is on defending against common attacks such as backdoor attacks and associated jailbreaks.
• Systematic evaluation of the robustness of LLMs against established and novel attack scenarios, regarding common and novel attacks such as backdoor attacks, divergence attacks, or membership inference attacks, etc.
• Investigation, application, and evaluation of post-hoc explainability methods to analyze model behavior, with the aim of gaining a deeper understanding of the underlying attack mechanisms as well as the effectiveness and limitations of corresponding defense strategies. 

What you contribute

• Very good Python skills, which will be tested in the interview.
• Basic understanding of AI/ML mainly in relation to transformers
• Experience with Pytorch and transformer architectures is desirable
• Good English skills
• Enrolled student (Computer Science, Data Science, Mathematics or similar)
• Structured, independent working style and ability to work in a team
• Strong analytical thinking

What we offer

• Flexible working hours that can be easily combined with your studies
• An inspiring work environment with state-of-the-art infrastructure
• The opportunity to gain practical experience and make valuable contacts in research
• Opportunity to collaborate on scientific papers and write a later bachelor's or master's thesis.
• Position can be remote or hybrid
• The monthly working time is about 40 hours, depending on the agreement 

We value and promote the diversity of our employees' skills and therefore welcome all applications – regardless of age, gender, nationality, ethnic and social origin, religion, ideology, disability, sexual orientation and identity. Severely disabled persons are given preference in the event of equal suitability. Our tasks are diverse and adaptable – for applicants with disabilities, we work together to find solutions that best promote their abilities. Remuneration according to the general works agreement for employing assistant staff.

With its focus on developing key technologies that are vital for the future and enabling the commercial utilization of this work by business and industry, Fraunhofer plays a central role in the innovation process. As a pioneer and catalyst for groundbreaking developments and scientific excellence, Fraunhofer helps shape society now and in the future. 

Ready for a change? Then apply now and make a difference! Once we have received your online application, you will receive an automatic confirmation of receipt. We will then get back to you as soon as possible and let you know what happens next.

Fraunhofer Institute for Secure Information Technology SIT

Requisition Number: 81268                Application Deadline: