Description
Job Title: Senior AWS Data Engineer
About the Role:
We are seeking an experienced and highly skilled Senior AWS Data Engineer with over 10 years of experience to join our dynamic team. The ideal candidate will have a deep understanding of data engineering principles extensive experience with AWS services and a proven track record of designing and implementing scalable data solutions.
Key Responsibilities:
- Design and implement robust scalable and efficient data pipelines and architectures on AWS.
- Develop data models and schemas to support business intelligence and analytics requirements.
- Utilize AWS services such as S3 Redshift EMR Glue Lambda and Kinesis to build and optimize data solutions.
- Implement data security and compliance measures using AWS IAM KMS and other security services.
- Design and develop ETL processes to ingest transform and load data from various sources into data warehouses and lakes.
- Ensure data quality and integrity through validation cleansing and transformation processes.
- Optimize data storage and retrieval performance through indexing partitioning and other techniques.
- Monitor and troubleshoot data pipelines to ensure high availability and reliability.
- Collaborate with cross-functional teams including data scientists analysts and business stakeholders to understand data requirements and deliver solutions.
- Provide technical leadership and mentorship to junior data engineers and team members.
- Identify opportunities to automate and streamline data processes for increased efficiency.
- Participate in on-call rotations to provide 24/7 support for critical systems and services.
Required Skills and Qualifications:
- Bachelors or Masters degree in Computer Science Information Technology or a related field.
- Over 10 years of experience in data engineering with a strong focus on AWS services.
- Proficiency in programming languages such as Python Java or Scala.
- Extensive experience with SQL and NoSQL databases.
- Strong understanding of data warehousing concepts and technologies.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.