Senior Python Data Engineer (ML project)
Senior Python Data Engineer (ML project)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
- Build cloud-native and hybrid data/machine learning pipelines.
- Collaborate closely with Solution Architects Cloud/Backend Architects Data Security engineers Data Scientists and Algorithm Developers.
- Actively develop enterprise tools for long-term internal use during ML model research.
- Provide technical support for research and early development activities.
- Organize and collate raw data.
- Prepare data for prescriptive and predictive modeling.
- Identify opportunities for automating data processes (e.g. curation validation). Requirements
Qualifications :
- Bachelors degree in computer science or a similar field.
- 7 years of experience in software engineering with Python including:
- Very good understanding of the Python Ecosystem (e.g. NumPy Pandas Scikit-learn)
- Coding best practices (e.g. TDD ATDD)
- Application Architecture and Design Patterns
- Testing strategies
- Versioning
- Significant experience with storage technologies and their advantages and disadvantages (e.g. Relational Database No-SQL Database Object Storage).
- Very good understanding of ML Workflows and how to provide suitable infrastructure pieces.
- Solid knowledge of HPC and AWS based data engineering and analytics solution.
- Experience with various data integration/ETL tools application integration business process and data science tools (e.g. Talend Kubeflow Spark Tableau Flume Kafka or Databricks).
- Experience working in a Linux environment.
Additional Information :
Nice-to-have:
- Data engineering certification (e.g AWS Professional Solution Architect IBM Certified Data Engineer) is a plus.
- Experience working in an international environment is a plus.
- Familiarity with MLops.
Remote Work :
Yes
Employment Type :
Full-time
Employment Type
Remote
Company Industry
Department / Functional Area
Engineering
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
