Lead Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
4 hours ago
Vacancies:
1 Vacancy
Job Summary
A Lead Data Engineer ensures their teams technology stack is fully compliant and managed within Experian security standards and policies. They act as a role model for best practice and high-quality technical output. Their mentoring brings tangible developmental benefit to the engineers they support. They lead and drive measurable technical improvement and innovation within their domain.
Does this sound like you Interested in finding out more You should apply.
Desirable but not essential experience:
- Fivetran Snowplow or Orchestra for data ingestion and orchestration
- Data Mesh principles with domain-oriented data ownership
- Change Data Capture (CDC) patterns and implementations
- Real-time / streaming architectures (e.g. Kafka Kinesis)
- MLOps or feature store implementations (e.g. SageMaker Feast)
- Migration of legacy data warehouses to modern data platforms
- FinOps practices and cloud cost optimisation for data platforms
- Security tooling and compliance experience (e.g. Veracode AquaSec Rapid7)
Qualifications :
As Lead Data Engineer you will combine deep technical expertise with leadership capability. You will drive the migration from legacy data systems to our modern stack establish engineering standards within your pod and ensure your team delivers high-quality reliable data products.
We require a Lead Data Engineer who is highly skilled in:
- Snowflake expertise (warehouses clustering RBAC performance tuning)
- dbt for modular transformations testing and CI/CD-enabled data pipelines
- Python for data engineering (pandas orchestration automation scripting)
- Advanced SQL skills (complex transformations query optimisation)
- AWS data services experience (S3 Glue Kinesis DMS Redshift)
- Data pipeline design and architecture across batch and streaming workloads
- Data quality frameworks (e.g. dbt tests Great Expectations or equivalent)
- Version control and CI/CD practices (Git GitHub Actions CodePipeline)
- Line management and technical mentoring of engineers
- Driving technical standards and best practices across teams
- Strong stakeholder partnership translating data needs into scalable solutions
- Creating onboarding materials documentation and selfservice learning resources
- Ability to communicate complex technical concepts to nontechnical audiences
You will lead a pod of Data Engineers in Hyderabad reporting to the UK-based Senior Data Engineering Manager. You are accountable for the technical output professional development and day-to-day management of your team. You will work asynchronously with UK colleagues and ensure your pod operates as true owners of their domain not as a support function.
A significant part of your role is enabling other teams to succeed with data. You will build relationships with Marketing Risk Analytics and Data Science teams to understand their challenges and help them navigate the data ecosystem. You will create and maintain onboarding resources run knowledge-sharing sessions and ensure teams can self-serve where appropriate. You measure success not just by pipelines delivered but by the outcomes your customers achieve.
Additional Information :
Our uniqueness is that we celebrate yours. Experians culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI work/life balance development authenticity collaboration wellness reward & recognition volunteering... the list goes on. Experians people first approach is award-winning; Worlds Best Workplaces 2024 (Fortune Top 25) Great Place To Work in 24 countries and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion colour sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, ... View more
