Job Title: Data Engineer with Gen AI
Location: Dallas TX
Job Type: Contract W2
Key Responsibilities:
- Design build and optimize scalable data pipelines and workflows for processing large datasets.
- Collaborate closely with Data Scientists to facilitate model development training and inference processes.
- Integrate and leverage Generative AI technologies to enhance data processing feature engineering and model development workflows.
- Write idiomatic and efficient Python code leveraging the latest features of Python 3.11.
- Ensure data integrity quality and availability across various systems.
- Implement and maintain best practices in data architecture security and governance.
Qualifications :
Required Qualifications:
- Strong proficiency in Python particularly idiomatic use of Python 3.11 features.
- Proven experience as a Data Engineer working on largescale data processing systems.
- Demonstrated experience supporting Data Science workflows (e.g. feature engineering model training inference pipelines).
- Experience with Generative AI frameworks and tools for data augmentation or model development.
- Solid understanding of data structures algorithms and ETL concepts.
- Experience with Azure Machine Learning for managing and deploying machine learning models.
- Handson experience with Azure Data Factory for orchestrating data workflows.
- Familiarity with other Azure data services (e.g. Data Lake Synapse).
Additional Information :
All your information will be kept confidential according to EEO guidelines.
Remote Work :
No
Employment Type :
Contract