Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Key Responsibilities:
- Design develop and maintain scalable realtime and batch data pipelines using AWS Glue Lambda Apache Spark and Kafka.
- Implement data lake architecture to ensure efficient data storage processing and retrieval.
- Collaborate with crossfunctional teams to understand data requirements and ensure the data infrastructure supports their needs.
- Use Terraform to manage and provision infrastructure in a reproducible and scalable manner.
- Optimize and troubleshoot complex data pipelines ensuring high availability and performance.
- Explore and integrate the latest technologies to enhance our data processing capabilities.
- Work in a fastpaced startuplike environment where you will take ownership of key projects and contribute to our overall data strategy.
Technical Requirements:
- 3 5 years of experience as an intermediate engineer with proficiency in AWS services.
- Strong programming skills in python and SQL.
- Strong experience with Apache Spark and Delta Lake for big data processing.
- Expertise in using Terraform for Infrastructure as Code (IAAC).
- Proficiency using standard DevOps tool such as Github Azure DevOps etc.
- Experience with Kafka and realtime data streaming pipelines along with geospatial data processing and analysis will be good to have.
Why Join Us
- Work with complex and large datasets that will challenge and expand your skill set.
- Be part of a startuplike environment where your ideas and contributions directly impact the companys success.
- Take ownership of projects and have the autonomy to drive them from inception to completion.
- Grow your career in a fastpaced environment with plenty of opportunities to learn and work with the latest technologies.
- Collaborate with a passionate and innovative team that values your input and encourages professional growth.
We thank you for your interest. Only those selected for an interview will be contacted.
GFL is committed to equal opportunity for all without regard to race religion color national origin citizenship sex sexual orientation gender identity age veteran status disability genetic information or any other protected characteristic. If you are interested in applying for employment and need special assistance or an accommodation to apply for a posted position please contact
Required Experience:
Senior IC
Employment Type
Full-Time
