Employer Active
Job Alert
You will be updated with latest job alerts via emailJob Alert
You will be updated with latest job alerts via emailImportant Information
Location: Pune
Experience: 6 to 9 years of work experience
Job Mode: Fulltime
Job Summary
As a Senior Data Engineer you will be a key member of our data team responsible for developing and maintaining infrastructure and pipelines. You will collaborate with crossfunctional teams to support datadriven decisionmaking and contribute to the growth and success of our datadriven initiatives.
This is a key role for an experienced engineer who thrives in developing highperformance scalable secure and resilient data systems using AWS cloudnative services Python and a mix of relational and nonrelational databases. This position offers the opportunity to work with the latest cloud technologies while also supporting and modernizing legacy onprem systems built with Microsoft technologies. You should be passionate about crafting modern data architectures and working across the full data lifecyclefrom ingestion to modeling to storage and access.
Key Responsibilities:
Architect develop and maintain highthroughput faulttolerant data pipelines using Python and AWS services such as AWS Glue Lambda Kinesis Step Functions and S3.
Design and optimize data models for both structured (relational) and semi/unstructured (nonrelational) data using databases such as Amazon RDS Aurora DynamoDB and Microsoft SQL Server (onprem).
Develop and integrate robust data ingestion solutions using REST APIs messaging systems (SNS/SQS/Kinesis) and filebased ingestion.
Collaborate with product and analytics teams to gather requirements and build data solutions that are scalable and maintainable.
Implement data quality lineage and validation checks to ensure reliable data delivery.
Lead efforts to migrate onprem workloads to cloudnative solutions on AWS.
Provide technical mentorship and guidance to junior team members and foster best practices in coding testing and operations.
Qualifications:
Bachelors or Masters degree in Computer Science Engineering or a related field.
5 years of experience in Data Engineering or similar roles with a strong emphasis on cloudnative architectures.
Deep expertise in Python for backend data processing scripting and automation.
Strong handson experience with a broad range of AWS data services such as:
oAWS Glue Lambda Step Functions Kinesis Athena Redshift S3 RDS DynamoDB
Solid understanding of relational databases (e.g. PostgreSQL MySQL SQL Server) and nonrelational databases (e.g. DynamoDB MongoDB Elasticsearch).
Proficiency in REST API development and integration including security authentication and performance tuning.
Strong knowledge of CI/CD pipelines infrastructureascode (IaC) and version control (e.g. Git).
Excellent debugging analytical and communication skills.
Preferred Skills:
Experience with big data tools such as Apache Spark Hadoop or EMR.
Familiarity with data cataloging data governance and data lake patterns.
Exposure to containerized environments (Docker ECS EKS) and orchestration.
Experience working with monitoring and alerting tools such as CloudWatch Datadog or Prometheus.
Nice to Have:
Certifications in AWS (e.g. AWS Certified Data Analytics Solutions Architect) or related disciplines.
Familiarity with data visualization and reporting tools such as QuickSight Power BI or Tableau.
About Encora
Encora is the preferred digital engineering and modernization partner of some of the worlds leading enterprises and digital native companies. With over 9000 experts in 47 offices and innovation labs worldwide Encoras technology practices include Product Engineering & Development Cloud Services Quality Engineering DevSecOps Data & Analytics Digital Experience Cybersecurity and AI & LLM Engineering.
At Encora we hire professionals based solely on their skills and qualifications and do not discriminate based on age disability religion gender sexual orientation socioeconomic status or nationality.
Required Experience:
Senior IC
Full Time