Lead Data Engineer – AWS
شارك هذه الوظيفة
موقع الوظيفة:
الراتب شهرياً:
تاريخ النشر:
أمس
عدد الوظائف الشاغرة:
1 عدد الوظائف الشاغرة
القسم:
ملخص الوظيفة
Lead Data Engineer AWS
Experience: 1012 Years
Location: Cairo Egypt (Onsite)
Employment Type: Full-Time
Position Overview
We are seeking an experienced Lead Data Engineer with deep expertise in AWS to architect lead and oversee the development of enterprise-grade scalable data platforms. The role demands strong technical leadership solution architecture skills and ownership of end-to-end data engineering initiatives. The candidate will mentor teams drive best practices and ensure secure high-performance and cost-optimized data solutions.
Key Responsibilities
- Lead design and implementation of batch and real-time data pipelines on AWS
- Architect and implement ETL/ELT solutions using AWS Glue Spark on EMR and other AWS-native services
- Lead workflow orchestration using Apache Airflow (MWAA)
- Architect serverless data processing solutions with AWS Lambda
- Design enterprise-grade data warehousing solutions using Amazon Redshift
- Develop and enforce data storage strategies using Amazon S3 and DynamoDB
- Implement and govern data cataloging governance and access control using AWS DataZone
- Establish monitoring logging and observability using Amazon CloudWatch
- Drive performance optimization scalability and cost efficiency
- Troubleshoot complex data processing and infrastructure issues
- Collaborate with cross-functional teams including Analytics BI Data Science and Business teams
- Provide technical leadership conduct code reviews and mentor junior engineers
- Ensure adherence to security compliance and data governance standards
- Participate in architecture discussions and contribute to long-term data strategy
Required Skills & Experience
- 1012 years of experience in Data Engineering or related roles
- 5 years of hands-on experience designing enterprise-grade AWS solutions
- Expertise with: AWS Glue Amazon EMR (Spark) AWS Lambda Apache Airflow (MWAA) Amazon EC2 Amazon CloudWatch Amazon Redshift Amazon DynamoDB AWS DataZone Amazon S3
- Strong programming skills in Python
- Advanced SQL skills with performance tuning expertise
- Strong understanding of data warehousing data modeling (Star/Snowflake) ETL/ELT best practices
- Experience designing scalable distributed data processing systems
- Proven experience in leading teams mentoring engineers and making architectural decisions
- Experience working in Agile/Scrum delivery environments
Nice to Have
- AWS Professional Certification (Solutions Architect / Data Analytics Specialty)
- Experience with real-time streaming (Kinesis Kafka)
- Exposure to metadata management data lineage and governance tools
- Expertise in cost optimization strategies in AWS
- Experience working with large-scale enterprise data platforms
Required Experience:
Senior IC
المهارات المطلوبة
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- البيانات الضخمة
- مستودع البيانات
- Kafka
- Scala
عن الشركة
Get access to all of our AWS best practices and insights. Subscribe Now Navigating the Cloud is was Complex Navigating the Cloud is was Complex Operating in today's cloud requires vision, strategy, skill, and persistence. Modern cloud infrastructures are incredibly capable,
