Role: Python Data Engineer III In-Person Interview for Final Round
Location: Houston TX (Onsite) Locals only
Duration: Contract
Client: Enterprise Products
Any Visa
Local people only
JOB DESCRIPTION
We are currently seeking an experienced Python Data Engineer to join the Big Data and Advanced Analytics department. The Senior Python Data Engineer will contribute to the development of a scalable high-performance data and AI platform using Amazon Web Services (AWS). The ideal candidate will combine strong software engineering principles with deep expertise in cloud platform engineering to build robust data and AI platform that drive business insights and decision-making.
Top daily responsibilities:
- Development of reusable Python libraries for Data and AI projects
- Development of AWS Infrastructure as Code (IaC) templates
- Development of Data and AI project templates
Must Have
- AWS with deployment automation such as Terraform and Cloud Formation
- Expert level Python programming
Nice To Have
- AWS Sage Maker
- Deploying Machine Learning projects to production
- Microservices Design
Other responsibilities include:
- Work directly with Data Scientists to develop high quality reliable scalable machine learning systems
- Design and implement frameworks and tools to streamline the machine learning process
- Automate manual ML pipelines including model training registration promotion and inferencing
- Leverage software architecture and design patterns to develop fault tolerant software components
- Convert research-based machine learning models into production-ready software
- Implement processes to ensure coding standards code quality documentation and test coverage
- Design and implement cloud-native architectures following AWS best practices for security scalability and cost optimization
- Implement Infrastructure as Code (IaC) using tools like CloudFormation Terraform or CDK
- Establish CI/CD pipelines for platform deployments and automated testing
The successful candidate will meet the following qualifications:
- 5 years of programming experience in Python building large distributed mission critical systems
- Expertise in developing and maintaining data pipelines
- Experience in testing packaging and deploying machine learning models
- Experience in software engineering practices such as Design Principles and Patterns Unit Testing Refactoring CI/CD and version control
- Expertise in Object-Oriented Design Principals and Functional Programming Principals
- Experience in implementing distributed computing systems
- Experience in designing modular reusable software components
- Experience in developing API endpoints and microservices
- Knowledgeable of MLOps Principles
- Knowledgeable of Knowledgeable of AWS data and AI services including Sage Maker Lake Formation Glue and Athena
Interview process: first round as short Teams video and second as onsite with small panel
Notes: new project must work onsite possibility to extend