PhD in Adapting Transformer Models for Defect Detection with Limited Data

Introduction

Join the NWO Perspectief FIND program and develop methods to adapt Transformer-based foundation models for defect detection where data is scarce and unlabeled. Explore few-shot learning self-supervised adaptation and synthetic data generation to enable robust scalable AI in semiconductor and printing systems. Work with leading industry partners like Canon and help transform quality inspection in next-generation high-tech equipment!

Job Description

Industrial edge deploymentsin semiconductor manufacturing industrial printing systems automotive radar smart mobility cameras and HealthTechrequire on-device AI to ensure low latency privacy and resilience. Todays Transformers models scale poorly and assume abundant cloud resources. The research program FIND aims to deliver architectural and algorithmic breakthroughs that enable foundation models to run predictably and efficiently on embedded processors and accelerators.

FIND is a research program funded by the Dutch government and industry that brings together 5 universities 11 companies (startups to multinationals) and 2 knowledge institutes to develop foundation models (large AI models) for Dutch hightech industry with strong emphasis on edge deployment privacy and timely decisionmaking. Partners include ASML NXP Canon Production Printing ASMPT Technolution Signify Shell Stryker TNO and others. A total of 12 PhDs will be employed on the FIND program covering topics from foundation model pre-training and multimodal adaptation to architectures and compression for edge deployment while targeting real-world validation in domains like HealthTech smart industry and autonomous mobility.

This PhD position focuses on adapting and fine-tuning Transformer-based foundation models for defect detection in high-tech manufacturing environments where only limited and largely unlabeled defect data is available. Current solutions typically rely on supervised CNN-based models trained on large labeled datasets which fail when defects are rare vary across machines or when labeling is prohibitively expensive. These approaches lack flexibility and generalization making them unsuitable for dynamic industrial settings with scarce and imbalanced data.

You will also explore few-shot learning self-supervised adaptation and multimodal integration techniques to overcome data scarcity and improve robustness. Unlike existing methods that depend on exhaustive annotation or handcrafted features this research will leverage the rich representations of foundation models and develop strategies for zero-shot or few-shot adaptation. You will investigate domain adaptation synthetic data generation and cross-modal learning to enable models that generalize across defect types and machine configurations. This ensures scalable accurate defect detection even in low-resource industrial contexts.

The resulting models will be validated in collaboration with a lead high-tech company demonstrating how foundation models can transform quality inspection by reducing dependency on labeled data and enabling rapid adaptation to new defect patternsclosing the gap between AI capability and real-world manufacturing constraints.

Research group and company

This position is embedded in the Mobile Perception Systems (MPS) Lab and Electronic Systems (ES) group within the Electrical Engineering department at Eindhoven University of Technology (TU/e). The MPS lab and ES group have a strong history of collaborative research projects leading to real-world impact.

This PhD project is executed in close collaboration with Canon Production Printing which is a global leader in high-end digital printing offering advanced hardware software and services aimed at professional and industrial-scale print environments.

Job Requirements

• A masters degree (or an equivalent university degree)in Computer Science Electrical Engineering Artificial Intelligence or related background.
• Strong background in machine learning computer vision and deep learning.
• Knowledge of transformer architectures and foundation models.
• Experience with few-shot learning self-supervised learning or domain adaptation is a plus.
• Proficiency in Python and deep learning frameworks (PyTorch TensorFlow).
• Ability to work in an interdisciplinary team.
• Motivated to develop your teaching skills and coach students.
• Fluent in spoken and written English (C1 level).
  
  

Conditions of Employment

A meaningful job in a dynamic and ambitious university in an interdisciplinary setting and within an international network. You will work on a beautiful green campus within walking distance of the central train addition we offer you:

• Full-time employment for four years with an intermediate assessment after nine months. You will spend a minimum of 10% of your four-year employment on teaching tasks with a maximum of 15% per year of your employment.
• Salary and benefits (such as a pension scheme paid pregnancy and maternity leave partially paid parental leave) in accordance with the Collective Labour Agreement for Dutch Universities scale P (min. 3059 - max. 3881).
• A year-end bonus of 8.3% and annual vacation pay of 8%.
• High-quality training programs and other support to grow into a self-aware autonomous scientific researcher. At TU/e we challenge you to take charge of your own learning process.
• An excellent technical infrastructure on-campus childrens day care and sports facilities.
• An allowance for commuting working from home and internet costs.
• A Staff Immigration Team and a tax compensation scheme (the 30% facility) for international candidates.

About us

Eindhoven University of Technology is a leading international university within the Brainport region where scientific curiosity meets a hands-on mindset. We work in an open and collaborative way with high-tech industries to tackle complex societal challenges. Our responsible and respectful approach ensures impact today and in the future. TU/e is home to over 13000 students and more than 7000 staff forming a diverse and vibrant academic community.

The mission of the Department of Electrical Engineering is to acquire share and transfer knowledge and understanding in the whole field of Electrical Engineering through education research and valorization. We work towards a Smart Sustainable Society a Connected World and a healthy humanity (Care & Cure). Activities share an application-oriented character a high degree of complexity and a large synergy between multiple facets of the field.

Research is carried out into the applications of electromagnetic phenomena in all forms of energy conversion telecommunication and electrical signal processing. Existing and new electrical components and systems are analyzed designed and built. The Electrical Engineering department takes its inspiration from contacts with high-tech industry in the direct surrounding region and beyond.

The department is innovative and has international ambitions and partnerships. The result is a challenging and inspiring setting in which socially relevant issues are addressed.

Information

Do you recognize yourself in this profile and would you like to know more Please contact the hiring manager . Sander Stuijk .

Visit our website for more information about the application process or the conditions of employment. You can also contactKevin Caris HR advisor or.

Curious to hear more about what its like as a PhD candidate at TU/e Please view the video.

Are you inspired and would like to know more about working at TU/e Please visit our career page.

Application

We invite you to submit a complete application by using the apply button. The application should include a:

• Cover letter in which you describe your motivation and qualifications for the position.
• Curriculum vitae including a list of your publications and the contact information of three references. Kindly note that we may reach out to references at any stage of the recruitment process. We recommend notifying your references upon submitting your application.

Ensure that you submit all the requested application documents. We give priority to complete applications.

We look forward to receiving your application and will screen it as soon as possible. The vacancy will remain open until the position is filled.

Please note

• You can apply online. We will not process applications sent by email and/or post.
• A pre-employment screening (e.g. knowledge security check) can be part of the selection procedure. For more information on the knowledge security check please consult the National Knowledge Security Guidelines.
• Please do not contact us for unsolicited services.