Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
- Design develop and maintain scalable ETL/ELT data pipelines for AI and analytics applications.
- Optimize data architectures and storage solutions using Databricks Snowflake and cloudbased platforms.
- Develop big data processing jobs using PySpark Spark SQL and distributed computing frameworks.
- Ensure data quality governance and security best practices across all environments.
- Implement CI/CD workflows for automated deployment and infrastructure as code (IaC).
- Collaborate with crossfunctional teams (data scientists software engineers analysts) to build endtoend data solutions.
- Lead troubleshooting and performance tuning efforts for highvolume data processing systems.
- Develop and maintain Pythonbased backend services to support data infrastructure.
- Implement Apache Airflow Dataplane or similar orchestration tools to automate and monitor workflows.
Qualifications :
- Strong proficiency in SQL for data processing and transformation.
- Strong knowledge of objectoriented programming in at least one language (Python Scala or Java).
- Handson experience deploying and managing largescale data pipelines in production environments.
- Expertise in workflow orchestration tools like Apache Airflow Dataplane or equivalent.
- Deep understanding of cloudbased data platforms such as Databricks and Snowflake.
- Knowledge of CI/CD pipelines and infrastructure as code for data workflows.
- Familiarity with cloud environments (AWS preferred Azure or GCP) and cloudnative data processing.
- Expertise in Spark PySpark and Spark SQL with a solid understanding of distributed computing frameworks.
- Proven ability to lead projects and mentor junior engineers in a fastpaced collaborative environment.
What about languages
Excellent written and verbal English for clear and effective communication is a must!
How much experience must I have
Were looking for someone with 6 years of experience working as a Data Engineer or related positions.
Additional Information :
Our perks and benefits:
Every day lunches! (headquarters)
- Vegetarian vegan gluten and sugar free options.
- Gourmet meals every Friday with our onsite chef!
Flexible working options to help you strike the right balance.
All the equipment you need to harness your talent (Macbook and accessories).
Snacks and beverages available everyday (headquarters).
After office events football tennis and game nights (headquarters).
- Everyone is welcome to join our football league every Wednesdays and Fridays.
- Challenge your teammates to a pool game and win the offices trophy!
- Tennis courts available for friendly matches.
- You are not a sports person Dont worry we also have chess championships game and music nights for you to join!
Learning opportunities:
- AWS Certifications (we are AWS Partners).
- Study plans courses and other certifications.
- English Lessons.
- Learn from your teammates on our Tech Tuesdays!
Mentoring and Development opportunities to shape your career path.
Anniversary and birthday gifts.
Great location and even greater teammates!
So what are the next steps
Our team is eager to learn about you! Send us your resume in english or LinkedIn profile below and well explore working together!
Remote Work :
Yes
Employment Type :
Fulltime
Employment Type
Remote
