Lead Data Platform Engineer

We are seeking a Lead Data Platform Engineer to act as a hands-on technical leader for our data platform engineering function.

You will be #LI-hybrid based in Hyderabad and reporting to Director Engineering

You will be responsible for designing building scalable data platforms while driving engineering best practices across the team.

You will help shape our AWS-native data ecosystem mentor engineers and ensure the delivery of high-quality reliable data solutions.

Key Responsibilities

• Be a hands-on technical lead across data engineering workstreams setting direction and standards
• You will Design build and optimise data lake architectures using a data mesh model
• Develop and maintain AWS-native data platforms using modern cloud services
• Implement DevOps best practices including Infrastructure-as-Code (IaC) using Terraform and CI/CD pipelines
• Apply configuration-as-code principles consistently across all environments.
• Embed automated testing monitoring and data quality frameworks into the development lifecycle
• Provide guidance and mentoring to engineers within the team
• Collaborate with cross-functional stakeholders to deliver robust and scalable data solutions
• Troubleshoot and optimize data workflows to ensure performance reliability and scalability

Qualifications :

• 8 years of relevant experience in Data Platform engineering
• Proven experience at Lead or Principal Engineer level within a large or enterprise environment
• Extensive hands-on experience with AWS data services including:
  • Glue
  • Step Functions
  • Lake Formation
  • EventBridge
  • Lambda
  • Datazone
  • Cloudwatch
• Strong experience designing and building data pipelines and data lake solutions
• Solid DevOps expertise including:
  • Terraform (Infrastructure-as-Code)
  • CI/CD pipelines
  • Git and Jenkins
• Working knowledge of AWS SageMaker Unified Studio
• Advanced programming skills in Python
• Experience with API integrations and configuration-as-code approaches
• Investigate and reconcile complex workflows
• Proven experience implementing automated testing frameworks within data engineering workflows

Desirable Attributes

• Continuous improvement and Innovation
• Experience working in agile delivery environments
• Passion for mentoring and developing engineering talent

Additional Information :

Our uniqueness is that we celebrate yours. Experians culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI work/life balance development authenticity collaboration wellness reward & recognition volunteering... the list goes on. Experians people first approach is award-winning; Worlds Best Workplaces 2024 (Fortune Global Top 25) Great Place To Work in 24 countries and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site and Glassdoor to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion color sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.

Benefits

Experian care for employees work life balance health safety and support of this endeavor we offer best-in-class family well-being benefits enhanced medical benefits and paid time off.

This is a hybrid remote/in-office role.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Remote Work :

No

Employment Type :

Full-time