Senior Staff AI DataValidation Engineer
Senior Staff AI DataValidation Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
$ 100 - 215
1 Vacancy
Job Description
What You Will Do:
We are looking for an experienced and highly skilled Senior Staff AI Data and Validation Engineer. A successful candidate will be responsible for developing methods and processes for scientific evaluation of AI/ML models used in medical devices ensuring compliance with all applicable FDA guidelines and regulations.
This role is crucial for maintaining the safety effectiveness and quality of AIenabled medical devices throughout their product lifecycle. The engineer will contribute to the design and analysis of validation studies ensuring that the devices perform predictably and reliably for their intended use and across all relevant demographic groups identify potential bias and placing a strong emphasis on comprehensive data management practices including data collection processing annotation storage and use. This includes ensuring data integrity quality and representativeness to mitigate potential biases and demonstrate the safety effectiveness and quality of AIenabled medical devices throughout their lifecycle.
- Create detailed validation plans protocols and reports for AIenabled medical device software functions encompassing both performance validation and model evaluation. This includes defining the scope of testing performance metrics and acceptance criteria
- Oversee the management of data used in both the development and validation of AI models ensuring the quality diversity and independence of datasets. This involves assessing data representativeness addressing potential biases and ensuring the appropriate separation of training and test datasets
- Work closely with the product development team to ensure a comprehensive approach to transparency and bias is taken throughout the total product lifecycle
- Critically evaluate the technical characteristics of AI models including their architecture features and parameters as well as the algorithms used in their development. A comprehensive evaluation will include assessing the quality control and data management methods used to produce the AIenabled device
- Develop and implement comprehensive risk assessment strategies for AI models considering potential and unintended biases limitations and cybersecurity vulnerabilities
- Conduct rigorous performance validation studies analyzing performance across different subgroups of the intended user population.
- Prepare and review documentation for regulatory submissions related to AI model validation including 510(k) submissions De Novo requests and PMA applications.
- Implement strategies to address transparency and bias throughout the device lifecycle from design to postmarket surveillance
- Prepare comprehensive documentation for regulatory submissions of AI/MLenabled medical devices including detailed descriptions of the device model development validation studies data management and risk assessments
- Stay abreast of the latest FDA guidelines regulations and industry best practices related to AI model validation in medical devices.
What You Will Need:
Required Qualifications:
- Bachelors Degree in Computer Science Machine Learning Electrical Engineering Mathematics Statistics Bioengineering Biomedical Engineering or related field
- 6 years of experience in computer vision and deep learning / machine learning development 4 years of work experience required if Masters Degree in the above field(s) and 2 years of experience with PhD in above field(s)
- 2 years of experience in statistic and descriptive data analysis / data science to help drive datadriven decision making.
Preferred Qualifications:
- Experience with Python or similar scripting and statistical language
- Substantial experience in the development and validation of AI models specifically within the medical device or healthcare industry. This experience should demonstrate a deep understanding of the entire model lifecycle including: Data Acquisition and preprocessing and labeling model training and tuning Model evaluation and performance bias detection and mitigation QMS documentation
- Strong foundation on Statistics and descriptive data analysis to help develop datadriven scientific rigor to AI model validation process including experience with confidence intervals development power analysis statistical tests etc. particularly when dealing with AI/ML model performance evaluation
- Experience in handling organizing categorizing big dataset with any commercial tools
- Experience with AI/ML frameworks such as PyTorch OpenCV TensorFlow scikitlearn etc. for model training and development and validation
- Experience with medical devices and product development in a regulated industry e.g. software developed under ISO 13485
- $100k $215k salary plus bonus eligible benefits. Actual minimum and maximum may vary based on pay is based on skills experience and other relevant factors.
Required Experience:
Staff IC
Employment Type
Full-Time
