Senior Python ETL Developer/Lead
Senior Python ETL Developer/Lead
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Title:Senior Python ETL Developer/Lead
Job Type: 6 Months Extendable
Experience :5 to 6 years
Job Description:
We are seeking an experienced Senior ETL Developer/Lead to join our team. The ideal candidate will have a strong background in developing ETL processes using Python and open-source tools/libraries including PySpark and Apache Airflow. This position requires a hands-on developer who can design implement and maintain robust ETL solutions and lead a team of developers.
Key Responsibilities:
- Design develop and maintain ETL processes to support data integration and data warehousing.
- Lead a team of ETL developers providing technical guidance and mentoring.
- Collaborate with data architects business analysts and other stakeholders to gather requirements and design solutions.
- Utilize open-source tools and libraries including PySpark to enhance ETL processes.
- Optimize and troubleshoot ETL processes to ensure timely and accurate data load.
- Develop and implement best practices for ETL development and data management.
- Perform data quality checks and validations to ensure data integrity.
- Create and maintain comprehensive ETL documentation.
- Stay updated with the latest trends and advancements in ETL and data integration technologies.
- Contribute to continuous process improvement initiatives.
Requirements:
- Bachelors or Masters degree in Computer Science Information Technology or related field.
- 5 years of experience in ETL development using Python.
- Experience with open-source ETL tools and libraries such as Apache Airflow PySpark and Pandas.
- Experience in development of database processes using Oracle SQL PL/SQL
- UNIX and/or Windows environments
- Scripting such as Shell Perl
- Object Oriented Analysis and Design (OOAD)
- Service Oriented Architecture (SOA)
- Strong understanding of data warehousing concepts data modeling and data integration.
- Excellent problem-solving skills and attention to detail.
- Ability to lead and mentor a team of developers.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Experience with containerization and orchestration tools (e.g. Docker Kubernetes).
- Familiarity with version control systems (e.g. Git).
- Experience in Agile/Scrum development methodologies.
Required Experience:
Senior IC
Employment Type
Contract
